Sep 04 15:42:33 devstack cinder-volume[76567]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 04 15:42:33 devstack cinder-volume[76567]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 04 15:42:33 devstack cinder-volume[76567]: we strongly recommend against using it for new projects. Sep 04 15:42:33 devstack cinder-volume[76567]: If you are already using Eventlet, we recommend migrating to a different Sep 04 15:42:33 devstack cinder-volume[76567]: framework. For more detail see Sep 04 15:42:33 devstack cinder-volume[76567]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 04 15:42:33 devstack cinder-volume[76567]: import eventlet # noqa Sep 04 15:42:35 devstack cinder-volume[76567]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76567) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 15:42:35 devstack cinder-volume[76567]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76567) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 15:42:35 devstack cinder-volume[76567]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76567) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 15:42:36 devstack cinder-volume[76567]: INFO dbcounter [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Registered counter for database cinder Sep 04 15:42:36 devstack cinder-volume[76567]: DEBUG oslo_db.sqlalchemy.engines [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76567) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 15:42:37 devstack cinder-volume[76567]: DEBUG dbcounter [-] [76567] Writer thread running {{(pid=76567) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 15:42:37 devstack cinder-volume[76567]: INFO cinder.rpc [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 04 15:42:37 devstack cinder-volume[76567]: INFO cinder.rpc [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 04 15:42:37 devstack cinder-volume[76567]: DEBUG oslo_db.sqlalchemy.engines [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76567) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 15:42:37 devstack cinder-volume[76567]: INFO cinder.volume.manager [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Determined volume DB was empty at startup. Sep 04 15:42:37 devstack cinder-volume[76567]: DEBUG cinder.volume.manager [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76567) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 04 15:42:37 devstack cinder-volume[76567]: INFO cinder.volume.manager [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 04 15:42:37 devstack cinder-volume[76567]: WARNING stevedore.named [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 04 15:42:37 devstack cinder-volume[76567]: WARNING castellan.key_manager [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 15:42:37 devstack cinder-volume[76567]: WARNING cinder.keymgr.conf_key_mgr [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 15:42:37 devstack cinder-volume[76567]: DEBUG cinder.volume.drivers.lvm [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76567) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 04 15:42:37 devstack cinder-volume[76567]: DEBUG oslo_concurrency.processutils [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:37 devstack cinder-volume[76567]: DEBUG oslo_concurrency.processutils [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] CMD "cinder-rtstool verify" returned: 0 in 0.533s {{(pid=76567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:37 devstack cinder-volume[76567]: DEBUG oslo_db.sqlalchemy.engines [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76567) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 15:42:37 devstack cinder-volume[76567]: INFO cinder.rpc [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 04 15:42:37 devstack cinder-volume[76567]: INFO cinder.rpc [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 04 15:42:37 devstack cinder-volume[76567]: WARNING stevedore.named [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 04 15:42:37 devstack cinder-volume[76567]: WARNING castellan.key_manager [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 15:42:37 devstack cinder-volume[76567]: INFO cinder.volume.manager [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 04 15:42:37 devstack cinder-volume[76567]: DEBUG oslo_db.sqlalchemy.engines [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76567) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 15:42:38 devstack cinder-volume[76567]: INFO oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Starting 1 workers Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Started child 76703 {{(pid=76567) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Full set of CONF: {{(pid=76567) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] ******************************************************************************** {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Configuration options gathered from: {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] ================================================================================ {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] allow_availability_zone_fallback = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] allow_compression_on_image_upload = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] allowed_direct_url_schemes = [] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] api_rate_limit = True {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] auth_strategy = keystone {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] az_cache_duration = 3600 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_availability_zone = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76703]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_host = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_name = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_stats_polling_interval = 60 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backup_api_class = cinder.backup.api.API {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backup_name_template = backup-%s {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backup_use_same_host = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backup_use_temp_snapshot = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] chap_password = **** {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] chap_username = {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cinder_internal_tenant_project_id = 4be693cd65c0470081998c14c97b9895 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cinder_internal_tenant_user_id = d3f7bd11bf8a438ebaffad8f0cffb382 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cloned_volume_same_az = True {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cluster = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] compression_format = gzip {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] compute_api_class = cinder.compute.nova.API {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] config_dir = [] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] config_source = [] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] control_exchange = openstack {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] debug = True {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] default_availability_zone = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] default_group_type = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] default_volume_type = lvmdriver-1 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] disk_geometry = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] driver_client_cert = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] driver_client_cert_key = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] driver_data_namespace = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] driver_ssl_cert_path = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] driver_ssl_cert_verify = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] driver_use_ssl = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] enable_force_upload = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] enable_new_services = True {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] enable_unsupported_driver = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] enforce_multipath_for_image_xfer = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] filter_function = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] glance_api_insecure = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] glance_api_servers = ['http://192.168.122.230/image'] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] glance_api_ssl_compression = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] glance_ca_certificates_file = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] glance_catalog_info = image:glance:publicURL {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] glance_certfile = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] glance_keyfile = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] glance_num_retries = 3 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] glance_request_timeout = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] goodness_function = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] graceful_shutdown_timeout = 5 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] group_api_class = cinder.group.api.API {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] host = devstack {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] image_compress_on_upload = True {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] image_conversion_address_space_limit = 1 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] image_conversion_cpu_limit = 60 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] image_conversion_disable = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] image_upload_use_cinder_backend = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] image_upload_use_internal_tenant = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] image_volume_cache_enabled = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] image_volume_cache_max_count = 0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] image_volume_cache_max_size_gb = 0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] init_host_max_objects_retrieval = 0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] instance_format = [instance: %(uuid)s] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] iscsi_target_flags = {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] iscsi_write_cache = on {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] iser_helper = tgtadm {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] iser_ip_address = 192.168.122.230 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] iser_port = 3260 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] log_color = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] log_config_append = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] log_dir = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] log_file = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] log_options = True {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] log_rotate_interval = 1 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] log_rotate_interval_type = days {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] log_rotation_type = none {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76703]: INFO cinder.volume.manager [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] max_age = 0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] max_logfile_count = 30 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] max_logfile_size_mb = 200 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] max_over_subscription_ratio = 20.0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] message_reap_interval = 86400 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] message_ttl = 2592000 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] migration_create_volume_timeout_secs = 300 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] monkey_patch = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] monkey_patch_modules = [] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] my_ip = 192.168.122.230 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] no_snapshot_gb_quota = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] num_iser_scan_tries = 3 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] num_shell_tries = 3 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] num_volume_device_scan_tries = 3 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] nvmeof_conn_info_version = 1 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] nvmet_ns_id = 10 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] nvmet_port_id = 1 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] osapi_max_limit = 1000 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] osapi_volume_ext_list = [] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] osapi_volume_listen_port = 8776 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] osapi_volume_use_ssl = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] osapi_volume_workers = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] per_volume_size_limit = -1 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:38 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] periodic_fuzzy_delay = 60 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] periodic_interval = 60 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] public_endpoint = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] publish_errors = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] quota_backup_gigabytes = 1000 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] quota_backups = 10 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] quota_gigabytes = 1000 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] quota_groups = 10 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] quota_snapshots = 10 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] quota_volumes = 10 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] rate_limit_burst = 0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] rate_limit_except_level = CRITICAL {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] rate_limit_interval = 0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] reinit_driver_count = 3 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] replication_device = **** {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] report_discard_supported = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] report_interval = 120 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:38 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] reservation_clean_interval = 86400 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] reservation_expire = 86400 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] reserved_image_namespaces = [] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] reserved_percentage = 0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] rpc_response_timeout = 120 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] run_external_periodic_tasks = True {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] scst_target_driver = iscsi {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] scst_target_iqn_name = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] service_down_time = 720 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] shell_completion = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] snapshot_name_template = snapshot-%s {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] snapshot_same_host = True {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] split_loggers = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] state_path = /opt/stack/data/cinder {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] storage_availability_zone = nova {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] storage_protocol = iSCSI {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] syslog_log_facility = LOG_USER {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] target_helper = lioadm {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] target_ip_address = 192.168.122.230 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] target_port = 3260 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] target_protocol = iscsi {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] target_secondary_ip_addresses = [] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] trace_flags = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:38 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] transport_url = **** {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] until_refresh = 0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] use_chap_auth = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] use_default_quota_class = True {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] use_journal = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] use_json = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] use_multipath_for_image_xfer = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] use_stderr = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] use_syslog = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] verify_glance_signatures = enabled {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] volume_api_class = cinder.volume.api.API {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] volume_backend_name = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] volume_clear = zero {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] volume_clear_ionice = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] volume_clear_size = 0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] volume_copy_bps_limit = 0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] volume_dd_blocksize = 1M {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] volume_name_template = volume-%s {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] volume_service_inithost_offload = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] volume_usage_audit_period = month {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack sudo[76711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 04 15:42:38 devstack sudo[76711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] zoning_mode = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_concurrency.disable_process_locking = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.auth_section = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.auth_type = password {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.auth_version = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.cache = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.certfile = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.include_service_catalog = True {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.insecure = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.interface = public {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.keyfile = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.memcache_password = **** {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.memcache_username = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.region_name = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.service_type = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.230/identity {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.backend = dogpile.cache.null {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.backend_argument = **** {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.backend_expiration_time = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.config_prefix = cache.oslo {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.debug_cache_backend = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.enable_retry_client = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.enable_socket_keepalive = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.enabled = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.expiration_time = 600 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.hashclient_retry_attempts = 2 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.memcache_dead_retry = 300 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.memcache_pool_maxsize = 10 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.memcache_sasl_enabled = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.password = **** {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.proxies = [] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.redis_db = 0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.redis_server = localhost:6379 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.retry_attempts = 2 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.retry_delay = 0.0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.socket_keepalive_count = 1 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.socket_keepalive_idle = 1 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.socket_keepalive_interval = 1 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.socket_timeout = 1.0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.tls_allowed_ciphers = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.tls_cafile = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.tls_certfile = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.tls_enabled = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.tls_keyfile = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cache.username = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] coordination.backend_url = **** {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] database.asyncio_connection = **** {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] database.asyncio_slave_connection = **** {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] database.backend = sqlalchemy {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] database.connection = **** {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] database.connection_debug = 0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] database.connection_parameters = {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] database.connection_recycle_time = 3600 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] database.connection_trace = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] database.db_inc_retry_interval = True {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] database.db_max_retries = 20 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] database.db_max_retry_interval = 10 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] database.db_retry_interval = 1 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] database.max_overflow = 50 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] database.max_pool_size = 5 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] database.max_retries = 10 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] database.mysql_wsrep_sync_wait = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] database.pool_timeout = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] database.retry_interval = 10 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] database.slave_connection = **** {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] database.sqlite_synchronous = True {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] database.synchronous_reader = True {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] database.use_db_reconnect = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_tracing.insecure = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] profiler.connection_string = messaging:// {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] profiler.enabled = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] profiler.es_doc_type = notification {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] profiler.es_scroll_size = 10000 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] profiler.es_scroll_time = 2m {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] profiler.filter_error_trace = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] profiler.hmac_keys = **** {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] profiler.sentinel_service_name = mymaster {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] profiler.socket_timeout = 0.1 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] profiler.trace_requests = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] profiler.trace_sqlalchemy = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] profiler_jaeger.process_tags = {} {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] profiler_jaeger.service_name_prefix = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] profiler_otlp.service_name_prefix = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_policy.enforce_new_defaults = True {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_policy.policy_default_rule = default {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_policy.policy_file = policy.yaml {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] privsep_osbrick.group = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] privsep_osbrick.helper_command = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] privsep_osbrick.user = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cinder_sys_admin.group = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cinder_sys_admin.helper_command = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] cinder_sys_admin.user = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] service_user.auth_section = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] service_user.auth_type = password {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] service_user.cafile = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] service_user.certfile = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] service_user.collect_timing = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] service_user.insecure = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] service_user.keyfile = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] service_user.send_service_user_token = True {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] service_user.split_loggers = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] service_user.timeout = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] service_user.tls_ciphers = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] service_user.tls_min_version = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] glance.auth_section = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] glance.auth_type = password {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] glance.certfile = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] glance.collect_timing = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] glance.insecure = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] glance.keyfile = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] glance.region_name = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] glance.split_loggers = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] glance.timeout = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] glance.tls_ciphers = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] glance.tls_min_version = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.backend_availability_zone = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.chap_password = **** {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.chap_username = {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.disk_geometry = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.driver_client_cert = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.driver_client_cert_key = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.driver_data_namespace = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.driver_use_ssl = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.extra_capabilities = {} {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.filter_function = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.goodness_function = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.iscsi_target_flags = {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.iscsi_write_cache = on {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.iser_helper = tgtadm {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.iser_ip_address = 192.168.122.230 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.iser_port = 3260 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.lvm_share_target = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.lvm_type = auto {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.num_shell_tries = 3 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.replication_device = **** {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.report_discard_supported = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.reserved_percentage = 0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.target_helper = tgtadm {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.target_ip_address = 192.168.122.230 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.target_port = 3260 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.target_protocol = iscsi {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.trace_flags = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.unique_fqdn_network = True {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.use_chap_auth = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.volume_backend_name = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.volume_clear = zero {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.volume_clear_ionice = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.volume_clear_size = 0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_reports.file_event_handler = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_reports.log_dir = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.backend_host = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.chap_password = **** {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.chap_username = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.disk_geometry = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.driver_client_cert = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.extra_capabilities = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.filter_function = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.goodness_function = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.iser_helper = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.iser_ip_address = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.iser_port = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.lvm_share_target = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.lvm_type = auto {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.num_shell_tries = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.replication_device = **** {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.report_discard_supported = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.reserved_percentage = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.scst_target_driver = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.storage_protocol = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.target_helper = lioadm {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.target_ip_address = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.target_port = 3260 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.trace_flags = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.use_chap_auth = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.volume_clear = zero {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.volume_clear_size = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] lvmdriver-1.volumes_dir = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.ssl = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_notifications.driver = [] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_notifications.retry = -1 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] key_manager.fixed_key = **** {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican.barbican_api_version = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican.barbican_endpoint = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican.barbican_endpoint_type = public {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican.barbican_region_name = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican.cafile = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican.certfile = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican.collect_timing = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican.insecure = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican.keyfile = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican.number_of_retries = 60 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican.retry_delay = 1 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican.send_service_user_token = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican.split_loggers = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican.timeout = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican.tls_ciphers = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican.tls_min_version = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican.verify_ssl = True {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican.verify_ssl_path = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican_service_user.auth_section = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican_service_user.auth_type = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican_service_user.cafile = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican_service_user.certfile = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican_service_user.collect_timing = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican_service_user.insecure = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican_service_user.keyfile = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican_service_user.split_loggers = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican_service_user.timeout = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican_service_user.tls_ciphers = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] barbican_service_user.tls_min_version = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] vault.approle_role_id = **** {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] vault.approle_secret_id = **** {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] vault.auth_method = approle {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] vault.auth_path = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] vault.kv_mountpoint = secret {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] vault.kv_path = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] vault.kv_version = 2 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] vault.namespace = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] vault.root_token_id = **** {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] vault.ssl_ca_crt_file = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] vault.timeout = 60.0 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] vault.token_file = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] vault.token_role = None {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] vault.use_ssl = False {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:42:38 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] ******************************************************************************** {{(pid=76567) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 04 15:42:38 devstack sudo[76711]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:38 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.328s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:38 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:38 devstack sudo[76722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 15:42:38 devstack sudo[76722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:38 devstack sudo[76722]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:38 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.259s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:38 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:42:38 devstack cinder-volume[76703]: INFO cinder.brick.local_dev.lvm [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 04 15:42:38 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:38 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:38 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:38 devstack sudo[76877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 15:42:38 devstack sudo[76877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:39 devstack sudo[76877]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:39 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:39 devstack cinder-volume[76703]: DEBUG cinder.brick.local_dev.lvm [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76703) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 04 15:42:39 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:39 devstack sudo[76965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 15:42:39 devstack sudo[76965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:39 devstack sudo[76965]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:39 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.519s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:39 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:39 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:39 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:39 devstack sudo[77165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 15:42:39 devstack sudo[77165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:39 devstack sudo[77165]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:39 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:39 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:39 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:39 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:40 devstack sudo[77262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 04 15:42:40 devstack sudo[77262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:40 devstack sudo[77262]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:40 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.316s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:40 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:40 devstack sudo[77321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 15:42:40 devstack sudo[77321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:40 devstack sudo[77321]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:40 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:40 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:40 devstack sudo[77347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 15:42:40 devstack sudo[77347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:40 devstack sudo[77347]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:40 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:40 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:40 devstack sudo[77408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:42:40 devstack sudo[77408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:41 devstack sudo[77408]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:41 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:41 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:41 devstack sudo[77416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 15:42:41 devstack sudo[77416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:41 devstack sudo[77416]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:41 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.312s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:41 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:41 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:41 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:41 devstack sudo[77481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 15:42:41 devstack sudo[77481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:41 devstack sudo[77481]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:41 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:41 devstack cinder-volume[76703]: INFO cinder.volume.drivers.lvm [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 04 15:42:41 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:41 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:41 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:41 devstack sudo[77511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 15:42:41 devstack sudo[77511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:42 devstack sudo[77511]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:42 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:42 devstack cinder-volume[76703]: DEBUG cinder.volume.drivers.lvm [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Updating volume stats {{(pid=76703) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 15:42:42 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:42 devstack sudo[77514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 15:42:42 devstack sudo[77514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:42 devstack sudo[77514]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:42 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:42 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:42 devstack sudo[77517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:42:42 devstack sudo[77517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:42 devstack sudo[77517]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:42 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:42 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:42 devstack sudo[77520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 15:42:42 devstack sudo[77520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:42 devstack sudo[77520]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:42 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:42 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:42 devstack sudo[77523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:42:42 devstack sudo[77523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:43 devstack sudo[77523]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:43 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:43 devstack cinder-volume[76703]: INFO cinder.volume.driver [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Driver hasn't implemented _init_vendor_properties() Sep 04 15:42:43 devstack cinder-volume[76703]: DEBUG cinder.volume.driver [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76703) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 04 15:42:43 devstack cinder-volume[76703]: DEBUG oslo_db.sqlalchemy.engines [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76703) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 15:42:43 devstack cinder-volume[76703]: DEBUG dbcounter [-] [76703] Writer thread running {{(pid=76703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 15:42:43 devstack cinder-volume[76703]: DEBUG cinder.db.api [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Building query based on filter {{(pid=76703) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 04 15:42:43 devstack cinder-volume[76703]: DEBUG cinder.image.image_utils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76703) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 04 15:42:43 devstack cinder-volume[76703]: INFO cinder.keymgr.migration [None req-bbcef87a-c2b8-48ff-893e-d1d89827fdf0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 04 15:42:43 devstack cinder-volume[76703]: DEBUG cinder.volume.drivers.lvm [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Updating volume stats {{(pid=76703) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 15:42:43 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:43 devstack sudo[77526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 15:42:43 devstack sudo[77526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:43 devstack sudo[77526]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:43 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:43 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:43 devstack sudo[77530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:42:43 devstack sudo[77530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:43 devstack sudo[77530]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:43 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:43 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:43 devstack sudo[77538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 15:42:43 devstack sudo[77538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:44 devstack sudo[77538]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:44 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:44 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:44 devstack sudo[77544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:42:44 devstack sudo[77544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:44 devstack sudo[77544]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:44 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:44 devstack cinder-volume[76703]: DEBUG cinder.manager [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Notifying Schedulers of capabilities ... {{(pid=76703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:42:44 devstack cinder-volume[76703]: INFO cinder.volume.manager [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Driver initialization completed successfully. Sep 04 15:42:44 devstack cinder-volume[76703]: INFO cinder.manager [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Initiating service 2 cleanup Sep 04 15:42:44 devstack cinder-volume[76703]: INFO cinder.manager [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Service 2 cleanup completed. Sep 04 15:42:44 devstack cinder-volume[76703]: DEBUG cinder.service [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Creating RPC server for service cinder-volume {{(pid=76703) start /opt/stack/cinder/cinder/service.py:231}} Sep 04 15:42:44 devstack cinder-volume[76703]: DEBUG cinder.service [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76703) start /opt/stack/cinder/cinder/service.py:237}} Sep 04 15:42:44 devstack cinder-volume[76703]: INFO cinder.volume.manager [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 04 15:42:44 devstack cinder-volume[76703]: DEBUG cinder.volume.drivers.lvm [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Updating volume stats {{(pid=76703) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 15:42:44 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:44 devstack sudo[77547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 15:42:44 devstack sudo[77547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:44 devstack sudo[77547]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:44 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:44 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:44 devstack sudo[77553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:42:44 devstack sudo[77553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:45 devstack sudo[77553]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:45 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:45 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:45 devstack sudo[77558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 15:42:45 devstack sudo[77558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:45 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:45 devstack sudo[77558]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:45 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:42:45 devstack sudo[77561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:42:45 devstack sudo[77561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:42:45 devstack sudo[77561]: pam_unix(sudo:session): session closed for user root Sep 04 15:42:45 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:42:45 devstack cinder-volume[76703]: INFO cinder.volume.manager [None req-3df67e7f-abab-4d90-9bbe-ceb29aba9af0 None None] Driver post RPC initialization completed successfully. Sep 04 15:42:48 devstack cinder-volume[76567]: DEBUG dbcounter [-] [76567] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76567) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:42:49 devstack cinder-volume[76703]: DEBUG oslo_service.periodic_task [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Running periodic task VolumeManager._thread_info {{(pid=76703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:42:49 devstack cinder-volume[76703]: DEBUG cinder.volume.manager [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] thread count: 6 {{(pid=76703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:42:49 devstack cinder-volume[76703]: DEBUG cinder.volume.manager [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] thread info: [<_MainThread(MainThread, started 130546159841408)>, , , , , ] {{(pid=76703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:42:55 devstack cinder-volume[76703]: DEBUG dbcounter [-] [76703] Writing DB stats cinder:SELECT=3 {{(pid=76703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:42:55 devstack cinder-volume[76703]: DEBUG dbcounter [-] [76703] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:43:49 devstack cinder-volume[76703]: DEBUG oslo_service.periodic_task [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:43:49 devstack cinder-volume[76703]: DEBUG cinder.volume.drivers.lvm [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Updating volume stats {{(pid=76703) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 15:43:49 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:43:49 devstack sudo[79613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 15:43:49 devstack sudo[79613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:43:49 devstack sudo[79613]: pam_unix(sudo:session): session closed for user root Sep 04 15:43:49 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:43:49 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:43:49 devstack sudo[79616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:43:49 devstack sudo[79616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:43:50 devstack sudo[79616]: pam_unix(sudo:session): session closed for user root Sep 04 15:43:50 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:43:50 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:43:50 devstack sudo[79619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 15:43:50 devstack sudo[79619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:43:50 devstack sudo[79619]: pam_unix(sudo:session): session closed for user root Sep 04 15:43:50 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:43:50 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:43:50 devstack sudo[79640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:43:50 devstack sudo[79640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:43:50 devstack sudo[79640]: pam_unix(sudo:session): session closed for user root Sep 04 15:43:50 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:43:50 devstack cinder-volume[76703]: DEBUG cinder.manager [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Notifying Schedulers of capabilities ... {{(pid=76703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:43:50 devstack cinder-volume[76703]: DEBUG oslo_service.periodic_task [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Running periodic task VolumeManager._thread_info {{(pid=76703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:43:50 devstack cinder-volume[76703]: DEBUG cinder.volume.manager [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] thread count: 6 {{(pid=76703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:43:50 devstack cinder-volume[76703]: DEBUG cinder.volume.manager [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] thread info: [<_MainThread(MainThread, started 130546159841408)>, , , , , ] {{(pid=76703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:44:49 devstack cinder-volume[76703]: DEBUG oslo_service.periodic_task [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:44:49 devstack cinder-volume[76703]: DEBUG cinder.volume.drivers.lvm [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Updating volume stats {{(pid=76703) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 15:44:49 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:44:49 devstack sudo[83003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 15:44:49 devstack sudo[83003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:44:49 devstack sudo[83003]: pam_unix(sudo:session): session closed for user root Sep 04 15:44:49 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:44:49 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:44:49 devstack sudo[83006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:44:49 devstack sudo[83006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:44:50 devstack sudo[83006]: pam_unix(sudo:session): session closed for user root Sep 04 15:44:50 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:44:50 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:44:50 devstack sudo[83014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 15:44:50 devstack sudo[83014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:44:50 devstack sudo[83014]: pam_unix(sudo:session): session closed for user root Sep 04 15:44:50 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:44:50 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:44:50 devstack sudo[83017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:44:50 devstack sudo[83017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:44:50 devstack sudo[83017]: pam_unix(sudo:session): session closed for user root Sep 04 15:44:50 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:44:50 devstack cinder-volume[76703]: DEBUG cinder.manager [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Notifying Schedulers of capabilities ... {{(pid=76703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:44:55 devstack cinder-volume[76703]: DEBUG dbcounter [-] [76703] Writing DB stats cinder:SELECT=1 {{(pid=76703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:44:55 devstack cinder-volume[76703]: DEBUG dbcounter [-] [76703] Writing DB stats cinder:UPDATE=1 {{(pid=76703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:45:49 devstack cinder-volume[76703]: DEBUG oslo_service.periodic_task [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:45:49 devstack cinder-volume[76703]: DEBUG cinder.volume.drivers.lvm [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Updating volume stats {{(pid=76703) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 15:45:49 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:45:49 devstack sudo[85152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 15:45:49 devstack sudo[85152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:45:49 devstack sudo[85152]: pam_unix(sudo:session): session closed for user root Sep 04 15:45:49 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:45:49 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:45:49 devstack sudo[85159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:45:49 devstack sudo[85159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:45:50 devstack sudo[85159]: pam_unix(sudo:session): session closed for user root Sep 04 15:45:50 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:45:50 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:45:50 devstack sudo[85164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 15:45:50 devstack sudo[85164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:45:50 devstack sudo[85164]: pam_unix(sudo:session): session closed for user root Sep 04 15:45:50 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:45:50 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:45:50 devstack sudo[85194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:45:50 devstack sudo[85194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:45:50 devstack sudo[85194]: pam_unix(sudo:session): session closed for user root Sep 04 15:45:50 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:45:50 devstack cinder-volume[76703]: DEBUG cinder.manager [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Notifying Schedulers of capabilities ... {{(pid=76703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:45:50 devstack cinder-volume[76703]: DEBUG oslo_service.periodic_task [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Running periodic task VolumeManager._thread_info {{(pid=76703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:45:50 devstack cinder-volume[76703]: DEBUG cinder.volume.manager [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] thread count: 6 {{(pid=76703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:45:50 devstack cinder-volume[76703]: DEBUG cinder.volume.manager [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] thread info: [<_MainThread(MainThread, started 130546159841408)>, , , , , ] {{(pid=76703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:46:49 devstack cinder-volume[76703]: DEBUG oslo_service.periodic_task [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:46:49 devstack cinder-volume[76703]: DEBUG cinder.volume.drivers.lvm [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Updating volume stats {{(pid=76703) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 15:46:49 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:46:49 devstack sudo[86354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 15:46:49 devstack sudo[86354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:46:49 devstack sudo[86354]: pam_unix(sudo:session): session closed for user root Sep 04 15:46:49 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:46:49 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:46:49 devstack sudo[86357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:46:49 devstack sudo[86357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:46:50 devstack sudo[86357]: pam_unix(sudo:session): session closed for user root Sep 04 15:46:50 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:46:50 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:46:50 devstack sudo[86360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 15:46:50 devstack sudo[86360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:46:50 devstack sudo[86360]: pam_unix(sudo:session): session closed for user root Sep 04 15:46:50 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:46:50 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:46:50 devstack sudo[86386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 15:46:50 devstack sudo[86386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:46:50 devstack sudo[86386]: pam_unix(sudo:session): session closed for user root Sep 04 15:46:50 devstack cinder-volume[76703]: DEBUG oslo_concurrency.processutils [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:46:50 devstack cinder-volume[76703]: DEBUG cinder.manager [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Notifying Schedulers of capabilities ... {{(pid=76703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:46:50 devstack cinder-volume[76703]: DEBUG oslo_service.periodic_task [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] Running periodic task VolumeManager._thread_info {{(pid=76703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:46:50 devstack cinder-volume[76703]: DEBUG cinder.volume.manager [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] thread count: 6 {{(pid=76703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:46:50 devstack cinder-volume[76703]: DEBUG cinder.volume.manager [None req-e15bf127-4485-4287-815d-4e7d45bceeee None None] thread info: [<_MainThread(MainThread, started 130546159841408)>, , , , , ] {{(pid=76703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:46:55 devstack cinder-volume[76703]: DEBUG dbcounter [-] [76703] Writing DB stats cinder:SELECT=1 {{(pid=76703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:46:55 devstack cinder-volume[76703]: DEBUG dbcounter [-] [76703] Writing DB stats cinder:UPDATE=1 {{(pid=76703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:46:58 devstack cinder-volume[76567]: INFO oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Caught SIGTERM, stopping children Sep 04 15:46:58 devstack cinder-volume[76567]: DEBUG oslo_concurrency.lockutils [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Acquiring lock "singleton_lock" {{(pid=76567) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 15:46:58 devstack cinder-volume[76567]: DEBUG oslo_concurrency.lockutils [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Acquired lock "singleton_lock" {{(pid=76567) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 15:46:58 devstack cinder-volume[76567]: DEBUG oslo_concurrency.lockutils [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Releasing lock "singleton_lock" {{(pid=76567) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 15:46:58 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Stop services. {{(pid=76567) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 04 15:46:58 devstack cinder-volume[76567]: DEBUG oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Killing children. {{(pid=76567) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 04 15:46:58 devstack cinder-volume[76567]: INFO oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Waiting on 1 children to exit Sep 04 15:46:59 devstack cinder-volume[76703]: DEBUG oslo_concurrency.lockutils [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Acquiring lock "singleton_lock" {{(pid=76703) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 15:46:59 devstack cinder-volume[76703]: DEBUG oslo_concurrency.lockutils [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Acquired lock "singleton_lock" {{(pid=76703) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 15:46:59 devstack cinder-volume[76703]: DEBUG oslo_concurrency.lockutils [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Releasing lock "singleton_lock" {{(pid=76703) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 15:46:59 devstack cinder-volume[76703]: WARNING amqp [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 04 15:46:59 devstack cinder-volume[76703]: WARNING amqp [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 04 15:46:59 devstack cinder-volume[76567]: INFO oslo_service.backend._eventlet.service [None req-3c7d6337-32bb-4bdd-979f-eee2a4d23d24 None None] Child 76703 exited with status 0 Sep 04 15:46:59 devstack cinder-volume[86699]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 04 15:46:59 devstack cinder-volume[86699]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 04 15:46:59 devstack cinder-volume[86699]: we strongly recommend against using it for new projects. Sep 04 15:46:59 devstack cinder-volume[86699]: If you are already using Eventlet, we recommend migrating to a different Sep 04 15:46:59 devstack cinder-volume[86699]: framework. For more detail see Sep 04 15:46:59 devstack cinder-volume[86699]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 04 15:46:59 devstack cinder-volume[86699]: import eventlet # noqa Sep 04 15:47:01 devstack cinder-volume[86699]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 15:47:01 devstack cinder-volume[86699]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 15:47:01 devstack cinder-volume[86699]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 15:47:02 devstack cinder-volume[86699]: INFO dbcounter [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] Registered counter for database cinder Sep 04 15:47:02 devstack cinder-volume[86699]: DEBUG oslo_db.sqlalchemy.engines [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 15:47:02 devstack cinder-volume[86699]: DEBUG dbcounter [-] [86699] Writer thread running {{(pid=86699) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 15:47:02 devstack cinder-volume[86699]: INFO cinder.rpc [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 04 15:47:03 devstack cinder-volume[86699]: INFO cinder.rpc [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_db.sqlalchemy.engines [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 15:47:03 devstack cinder-volume[86699]: INFO cinder.volume.manager [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] Determined volume DB was empty at startup. Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG cinder.volume.manager [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86699) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 04 15:47:03 devstack cinder-volume[86699]: INFO cinder.volume.manager [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 04 15:47:03 devstack cinder-volume[86699]: WARNING stevedore.named [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 04 15:47:03 devstack cinder-volume[86699]: WARNING castellan.key_manager [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 15:47:03 devstack cinder-volume[86699]: WARNING cinder.keymgr.conf_key_mgr [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 15:47:03 devstack cinder-volume[86699]: INFO cinder.volume.manager [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_db.sqlalchemy.engines [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 15:47:03 devstack cinder-volume[86699]: INFO oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] Starting 1 workers Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] Started child 86913 {{(pid=86699) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] Full set of CONF: {{(pid=86699) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] ******************************************************************************** {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] Configuration options gathered from: {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] ================================================================================ {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] allow_availability_zone_fallback = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] allow_compression_on_image_upload = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] allowed_direct_url_schemes = [] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] api_rate_limit = True {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] auth_strategy = keystone {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_availability_zone = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_host = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_name = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_stats_polling_interval = 60 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backup_api_class = cinder.backup.api.API {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backup_name_template = backup-%s {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backup_use_same_host = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backup_use_temp_snapshot = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] chap_password = **** {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] chap_username = {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cinder_internal_tenant_project_id = 4be693cd65c0470081998c14c97b9895 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cinder_internal_tenant_user_id = d3f7bd11bf8a438ebaffad8f0cffb382 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cluster = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] compression_format = gzip {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] compute_api_class = cinder.compute.nova.API {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] config_dir = [] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] config_source = [] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] control_exchange = openstack {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] debug = True {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] default_availability_zone = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] default_group_type = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] default_volume_type = QuobyteHD {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] disk_geometry = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] driver_client_cert = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] driver_client_cert_key = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] driver_data_namespace = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] driver_ssl_cert_path = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] driver_ssl_cert_verify = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] driver_use_ssl = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] enable_new_services = True {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] enable_unsupported_driver = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] enabled_backends = ['QuobyteHD'] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] enforce_multipath_for_image_xfer = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] filter_function = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] glance_api_insecure = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] glance_api_servers = ['http://192.168.122.230/image'] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] glance_api_ssl_compression = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] glance_ca_certificates_file = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] glance_catalog_info = image:glance:publicURL {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] glance_certfile = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] glance_keyfile = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] glance_num_retries = 3 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] glance_request_timeout = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] goodness_function = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] graceful_shutdown_timeout = 5 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] group_api_class = cinder.group.api.API {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] host = devstack {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] image_compress_on_upload = True {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] image_conversion_address_space_limit = 1 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86913]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] image_conversion_cpu_limit = 60 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] image_conversion_disable = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] image_upload_use_cinder_backend = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] image_upload_use_internal_tenant = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] image_volume_cache_enabled = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] image_volume_cache_max_count = 0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] image_volume_cache_max_size_gb = 0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] init_host_max_objects_retrieval = 0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] instance_format = [instance: %(uuid)s] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] iscsi_target_flags = {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] iscsi_write_cache = on {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] iser_helper = tgtadm {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] iser_ip_address = 192.168.122.230 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] iser_port = 3260 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] log_color = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] log_config_append = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] log_dir = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] log_file = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] log_options = True {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] log_rotate_interval = 1 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] log_rotate_interval_type = days {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] log_rotation_type = none {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] max_age = 0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] max_logfile_count = 30 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] max_logfile_size_mb = 200 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] max_over_subscription_ratio = 20.0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] message_reap_interval = 86400 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] message_ttl = 2592000 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] migration_create_volume_timeout_secs = 300 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] monkey_patch = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] monkey_patch_modules = [] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] my_ip = 192.168.122.230 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] no_snapshot_gb_quota = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] num_iser_scan_tries = 3 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] num_shell_tries = 3 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] num_volume_device_scan_tries = 3 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] nvmeof_conn_info_version = 1 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] nvmet_ns_id = 10 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] nvmet_port_id = 1 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] osapi_max_limit = 1000 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] osapi_volume_ext_list = [] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] osapi_volume_listen = 0.0.0.0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] osapi_volume_listen_port = 8776 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] osapi_volume_use_ssl = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] osapi_volume_workers = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] per_volume_size_limit = -1 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] periodic_fuzzy_delay = 60 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] periodic_interval = 60 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] project_id_regex = [0-9a-f\-]+ {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] public_endpoint = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] publish_errors = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] quota_backup_gigabytes = 1000 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] quota_backups = 10 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] quota_gigabytes = 1000 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] quota_groups = 10 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] quota_snapshots = 10 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] quota_volumes = 10 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] rate_limit_burst = 0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] rate_limit_except_level = CRITICAL {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] rate_limit_interval = 0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] reinit_driver_count = 3 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] replication_device = **** {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] report_discard_supported = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.remotefs [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86913) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] report_interval = 120 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] reservation_clean_interval = 86400 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] reservation_expire = 86400 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] reserved_image_namespaces = [] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] reserved_percentage = 0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] rpc_response_timeout = 120 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] run_external_periodic_tasks = True {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] scst_target_driver = iscsi {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] scst_target_iqn_name = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] service_down_time = 720 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] shell_completion = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] snapshot_name_template = snapshot-%s {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] split_loggers = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] state_path = /opt/stack/data/cinder {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] storage_availability_zone = nova {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] storage_protocol = iSCSI {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] syslog_log_facility = LOG_USER {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] target_helper = lioadm {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] target_ip_address = 192.168.122.230 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] target_port = 3260 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] target_protocol = iscsi {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] target_secondary_ip_addresses = [] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] trace_flags = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] transfer_api_class = cinder.transfer.api.API {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] transport_url = **** {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] until_refresh = 0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] use_chap_auth = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] use_default_quota_class = True {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] use_journal = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] use_json = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] use_multipath_for_image_xfer = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] use_stderr = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] use_syslog = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] verify_glance_signatures = enabled {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] volume_api_class = cinder.volume.api.API {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] volume_backend_name = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] volume_clear = zero {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] volume_clear_ionice = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] volume_clear_size = 0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] volume_copy_bps_limit = 0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] volume_dd_blocksize = 1M {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] volume_name_template = volume-%s {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] volume_service_inithost_offload = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] volume_usage_audit_period = month {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] zoning_mode = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_concurrency.disable_process_locking = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.auth_section = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.auth_type = password {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.auth_version = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.cache = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.certfile = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.delay_auth_decision = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.http_connect_timeout = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.include_service_catalog = True {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.insecure = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.interface = public {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.keyfile = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.memcache_password = **** {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.memcache_username = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.region_name = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.service_token_roles_required = True {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.service_type = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.token_cache_time = 300 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.230/identity {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.backend = dogpile.cache.null {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.backend_argument = **** {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.backend_expiration_time = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.config_prefix = cache.oslo {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.debug_cache_backend = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.enable_retry_client = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.enable_socket_keepalive = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.enabled = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.expiration_time = 600 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.hashclient_retry_attempts = 2 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.memcache_dead_retry = 300 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.memcache_pool_maxsize = 10 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.memcache_sasl_enabled = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.password = **** {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.proxies = [] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.redis_db = 0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.redis_sentinel_service_name = mymaster {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.redis_server = localhost:6379 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.retry_attempts = 2 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.retry_delay = 0.0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.socket_keepalive_count = 1 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.socket_keepalive_idle = 1 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.socket_keepalive_interval = 1 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.socket_timeout = 1.0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.tls_allowed_ciphers = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.tls_cafile = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.tls_certfile = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.tls_enabled = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.tls_keyfile = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cache.username = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] coordination.backend_url = **** {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] database.asyncio_connection = **** {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] database.asyncio_slave_connection = **** {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] database.backend = sqlalchemy {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] database.connection = **** {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] database.connection_debug = 0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] database.connection_parameters = {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] database.connection_recycle_time = 3600 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] database.connection_trace = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] database.db_inc_retry_interval = True {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] database.db_max_retries = 20 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] database.db_max_retry_interval = 10 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] database.db_retry_interval = 1 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] database.max_overflow = 50 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] database.max_pool_size = 5 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] database.max_retries = 10 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] database.mysql_wsrep_sync_wait = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] database.pool_timeout = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] database.retry_interval = 10 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] database.slave_connection = **** {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] database.sqlite_synchronous = True {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] database.synchronous_reader = True {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] database.use_db_reconnect = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_tracing.insecure = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] profiler.connection_string = messaging:// {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] profiler.enabled = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] profiler.es_doc_type = notification {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] profiler.es_scroll_size = 10000 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] profiler.es_scroll_time = 2m {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] profiler.filter_error_trace = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] profiler.hmac_keys = **** {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] profiler.sentinel_service_name = mymaster {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] profiler.socket_timeout = 0.1 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] profiler.trace_requests = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] profiler.trace_sqlalchemy = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] profiler_jaeger.process_tags = {} {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] profiler_jaeger.service_name_prefix = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] profiler_otlp.service_name_prefix = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_policy.enforce_new_defaults = True {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_policy.policy_default_rule = default {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_policy.policy_file = policy.yaml {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_policy.remote_timeout = 60.0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] privsep_osbrick.group = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] privsep_osbrick.helper_command = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] privsep_osbrick.user = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cinder_sys_admin.group = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cinder_sys_admin.helper_command = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] cinder_sys_admin.user = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] service_user.auth_section = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] service_user.auth_type = password {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] service_user.cafile = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] service_user.certfile = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] service_user.collect_timing = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] service_user.insecure = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] service_user.keyfile = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] service_user.send_service_user_token = True {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] service_user.split_loggers = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] service_user.timeout = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] service_user.tls_ciphers = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] service_user.tls_min_version = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] glance.auth_section = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] glance.auth_type = password {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] glance.certfile = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] glance.collect_timing = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] glance.insecure = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] glance.keyfile = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] glance.region_name = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] glance.split_loggers = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] glance.timeout = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] glance.tls_ciphers = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] glance.tls_min_version = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.backend_availability_zone = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.chap_password = **** {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.chap_username = {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.disk_geometry = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.driver_client_cert = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.driver_client_cert_key = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.driver_data_namespace = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.driver_use_ssl = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.enable_unsupported_driver = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.extra_capabilities = {} {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.filter_function = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.goodness_function = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.iscsi_target_flags = {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.iscsi_write_cache = on {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.iser_helper = tgtadm {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.iser_ip_address = 192.168.122.230 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.iser_port = 3260 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.nas_host = {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.nas_login = admin {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.nas_mount_options = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.nas_password = **** {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.nas_private_key = {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.nas_share_path = {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.nas_ssh_port = 22 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.num_shell_tries = 3 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.nvmet_port_id = 1 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.quobyte_client_cfg = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.quobyte_volume_url = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.replication_device = **** {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.report_discard_supported = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.reserved_percentage = 0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.scst_target_driver = iscsi {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.scst_target_iqn_name = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.storage_protocol = iSCSI {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.target_helper = tgtadm {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.target_ip_address = 192.168.122.230 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.target_port = 3260 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.target_protocol = iscsi {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.trace_flags = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.unique_fqdn_network = True {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.use_chap_auth = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.volume_backend_name = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.volume_clear = zero {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.volume_clear_ionice = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.volume_clear_size = 0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_reports.file_event_handler = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_reports.log_dir = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.backend_availability_zone = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.backend_host = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.chap_password = **** {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.chap_username = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.chiscsi_conf = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.disk_geometry = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.driver_client_cert = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.driver_client_cert_key = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.driver_data_namespace = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.driver_use_ssl = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.extra_capabilities = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.filter_function = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.goodness_function = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.iscsi_target_flags = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.iscsi_write_cache = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.iser_helper = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.iser_ip_address = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.iser_port = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.iser_target_prefix = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.nas_host = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.nas_login = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.nas_mount_options = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.nas_password = **** {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.nas_private_key = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.nas_share_path = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.nas_ssh_port = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.num_shell_tries = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.nvmet_ns_id = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86913) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 04 15:47:03 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.quobyte [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.nvmet_port_id = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86913]: WARNING cinder.volume.drivers.quobyte [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.replication_device = **** {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.report_discard_supported = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.reserved_percentage = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.scst_target_driver = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.storage_protocol = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.target_helper = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.target_ip_address = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.target_port = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.target_prefix = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.target_protocol = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.trace_flags = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.unique_fqdn_network = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.use_chap_auth = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Running cmd (subprocess): mount.quobyte {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.volume_clear = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.volume_clear_ionice = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.volume_clear_size = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] QuobyteHD.volumes_dir = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.ssl = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.ssl_version = {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_notifications.driver = [] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_notifications.retry = -1 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] oslo_messaging_notifications.transport_url = **** {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] key_manager.fixed_key = **** {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican.barbican_api_version = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican.barbican_endpoint = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican.barbican_endpoint_type = public {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican.barbican_region_name = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican.cafile = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican.certfile = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican.collect_timing = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican.insecure = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican.keyfile = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican.number_of_retries = 60 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican.retry_delay = 1 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican.send_service_user_token = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican.split_loggers = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican.timeout = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican.tls_ciphers = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican.tls_min_version = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican.verify_ssl = True {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican.verify_ssl_path = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican_service_user.auth_section = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican_service_user.auth_type = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican_service_user.cafile = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican_service_user.certfile = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican_service_user.collect_timing = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican_service_user.insecure = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican_service_user.keyfile = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican_service_user.split_loggers = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican_service_user.timeout = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican_service_user.tls_ciphers = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] barbican_service_user.tls_min_version = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] vault.approle_role_id = **** {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] vault.approle_secret_id = **** {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] vault.auth_method = approle {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] vault.auth_path = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] vault.kv_mountpoint = secret {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] vault.kv_path = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] vault.kv_version = 2 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] vault.namespace = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] vault.root_token_id = **** {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] vault.ssl_ca_crt_file = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] vault.timeout = 60.0 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] vault.token_file = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] vault.token_role = None {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] vault.use_ssl = False {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:03 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] ******************************************************************************** {{(pid=86699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 04 15:47:03 devstack quobyte-client[86918]: Reading configuration file: /etc/quobyte/client.cfg Sep 04 15:47:03 devstack quobyte-client[86918]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 04 15:47:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] CMD "mount.quobyte" returned: 1 in 0.086s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:47:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:47:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:47:03 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:47:03 devstack cinder-volume[86913]: INFO cinder.volume.drivers.quobyte [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 ... Sep 04 15:47:03 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f -c /etc/quobyte/client-cinder.cfg {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:47:03 devstack sudo[86919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f -c /etc/quobyte/client-cinder.cfg Sep 04 15:47:03 devstack sudo[86919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:47:04 devstack sudo[86919]: pam_unix(sudo:session): session closed for user root Sep 04 15:47:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.407s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:47:04 devstack cinder-volume[86913]: INFO cinder.volume.drivers.quobyte [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 succeeded Sep 04 15:47:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:47:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.418s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:47:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:47:04 devstack sudo[86988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:47:04 devstack sudo[86988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:47:04 devstack sudo[86988]: pam_unix(sudo:session): session closed for user root Sep 04 15:47:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.264s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:47:04 devstack cinder-volume[86913]: INFO cinder.volume.driver [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Driver hasn't implemented _init_vendor_properties() Sep 04 15:47:04 devstack cinder-volume[86913]: DEBUG cinder.volume.driver [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7594451904297, 'free_capacity_gb': 1773.7594451904297, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86913) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 04 15:47:04 devstack cinder-volume[86913]: DEBUG oslo_db.sqlalchemy.engines [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86913) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 15:47:04 devstack cinder-volume[86913]: DEBUG dbcounter [-] [86913] Writer thread running {{(pid=86913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 15:47:04 devstack cinder-volume[86913]: DEBUG cinder.db.api [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Building query based on filter {{(pid=86913) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 04 15:47:04 devstack cinder-volume[86913]: DEBUG cinder.image.image_utils [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86913) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 04 15:47:04 devstack cinder-volume[86913]: INFO cinder.keymgr.migration [None req-554349ea-4740-43e0-b61c-0b6028b9baf4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 04 15:47:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:47:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:47:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:47:04 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:47:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:47:04 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:47:04 devstack sudo[86998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:47:04 devstack sudo[86998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:47:04 devstack sudo[86998]: pam_unix(sudo:session): session closed for user root Sep 04 15:47:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.353s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:47:05 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:47:05 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Driver initialization completed successfully. Sep 04 15:47:05 devstack cinder-volume[86913]: INFO cinder.manager [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Initiating service 3 cleanup Sep 04 15:47:05 devstack cinder-volume[86913]: INFO cinder.manager [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Service 3 cleanup completed. Sep 04 15:47:05 devstack cinder-volume[86913]: DEBUG cinder.service [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Creating RPC server for service cinder-volume {{(pid=86913) start /opt/stack/cinder/cinder/service.py:231}} Sep 04 15:47:05 devstack cinder-volume[86913]: DEBUG cinder.service [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86913) start /opt/stack/cinder/cinder/service.py:237}} Sep 04 15:47:05 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 04 15:47:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:47:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:47:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:47:05 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:47:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:47:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:47:05 devstack sudo[87020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:47:05 devstack sudo[87020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:47:05 devstack sudo[87020]: pam_unix(sudo:session): session closed for user root Sep 04 15:47:05 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.449s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:47:06 devstack cinder-volume[86913]: INFO cinder.volume.manager [None req-948454cd-f2a3-4614-9f8f-c8e150c36188 None None] Driver post RPC initialization completed successfully. Sep 04 15:47:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a8853207-596d-43c5-ad67-4d8b00dbd107 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:47:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a8853207-596d-43c5-ad67-4d8b00dbd107 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:47:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a8853207-596d-43c5-ad67-4d8b00dbd107 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=86913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:47:08 devstack cinder-volume[86913]: DEBUG cinder.volume.drivers.quobyte [None req-a8853207-596d-43c5-ad67-4d8b00dbd107 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=86913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:47:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-a8853207-596d-43c5-ad67-4d8b00dbd107 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:47:08 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a8853207-596d-43c5-ad67-4d8b00dbd107 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:47:08 devstack sudo[87114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:47:08 devstack sudo[87114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:47:09 devstack sudo[87114]: pam_unix(sudo:session): session closed for user root Sep 04 15:47:09 devstack cinder-volume[86913]: DEBUG oslo_concurrency.processutils [None req-a8853207-596d-43c5-ad67-4d8b00dbd107 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.235s {{(pid=86913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:47:09 devstack cinder-volume[86913]: DEBUG cinder.manager [None req-a8853207-596d-43c5-ad67-4d8b00dbd107 None None] Notifying Schedulers of capabilities ... {{(pid=86913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:47:12 devstack cinder-volume[86699]: INFO oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] Caught SIGTERM, stopping children Sep 04 15:47:12 devstack cinder-volume[86699]: DEBUG oslo_concurrency.lockutils [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] Acquiring lock "singleton_lock" {{(pid=86699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 15:47:12 devstack cinder-volume[86699]: DEBUG oslo_concurrency.lockutils [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] Acquired lock "singleton_lock" {{(pid=86699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 15:47:12 devstack cinder-volume[86699]: DEBUG oslo_concurrency.lockutils [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] Releasing lock "singleton_lock" {{(pid=86699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 15:47:12 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] Stop services. {{(pid=86699) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 04 15:47:12 devstack cinder-volume[86699]: DEBUG oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] Killing children. {{(pid=86699) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 04 15:47:12 devstack cinder-volume[86699]: INFO oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] Waiting on 1 children to exit Sep 04 15:47:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] Acquiring lock "singleton_lock" {{(pid=86913) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 15:47:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] Acquired lock "singleton_lock" {{(pid=86913) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 15:47:13 devstack cinder-volume[86913]: DEBUG oslo_concurrency.lockutils [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] Releasing lock "singleton_lock" {{(pid=86913) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 15:47:13 devstack cinder-volume[86913]: WARNING amqp [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 04 15:47:13 devstack cinder-volume[86913]: WARNING amqp [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 04 15:47:13 devstack cinder-volume[86699]: INFO oslo_service.backend._eventlet.service [None req-930d8173-3e3e-4ac3-b415-0e196bbeab9b None None] Child 86913 exited with status 0 Sep 04 15:47:14 devstack cinder-volume[87187]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 04 15:47:14 devstack cinder-volume[87187]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 04 15:47:14 devstack cinder-volume[87187]: we strongly recommend against using it for new projects. Sep 04 15:47:14 devstack cinder-volume[87187]: If you are already using Eventlet, we recommend migrating to a different Sep 04 15:47:14 devstack cinder-volume[87187]: framework. For more detail see Sep 04 15:47:14 devstack cinder-volume[87187]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 04 15:47:14 devstack cinder-volume[87187]: import eventlet # noqa Sep 04 15:47:17 devstack cinder-volume[87187]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87187) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 15:47:17 devstack cinder-volume[87187]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87187) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 15:47:17 devstack cinder-volume[87187]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87187) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 15:47:18 devstack cinder-volume[87187]: INFO dbcounter [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] Registered counter for database cinder Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_db.sqlalchemy.engines [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87187) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG dbcounter [-] [87187] Writer thread running {{(pid=87187) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 15:47:18 devstack cinder-volume[87187]: INFO cinder.rpc [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 04 15:47:18 devstack cinder-volume[87187]: INFO cinder.rpc [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_db.sqlalchemy.engines [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87187) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 15:47:18 devstack cinder-volume[87187]: INFO cinder.volume.manager [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] Determined volume DB was empty at startup. Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG cinder.volume.manager [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87187) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 04 15:47:18 devstack cinder-volume[87187]: WARNING stevedore.named [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 04 15:47:18 devstack cinder-volume[87187]: WARNING castellan.key_manager [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 15:47:18 devstack cinder-volume[87187]: WARNING cinder.keymgr.conf_key_mgr [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 15:47:18 devstack cinder-volume[87187]: INFO cinder.volume.manager [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_db.sqlalchemy.engines [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87187) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 15:47:18 devstack cinder-volume[87187]: INFO oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] Starting 1 workers Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] Started child 87490 {{(pid=87187) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] Full set of CONF: {{(pid=87187) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] ******************************************************************************** {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] Configuration options gathered from: {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] ================================================================================ {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] allow_availability_zone_fallback = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] allow_compression_on_image_upload = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] allowed_direct_url_schemes = [] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] api_rate_limit = True {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] auth_strategy = keystone {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_availability_zone = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_host = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_name = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_stats_polling_interval = 60 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backup_api_class = cinder.backup.api.API {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backup_name_template = backup-%s {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backup_use_same_host = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backup_use_temp_snapshot = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] chap_password = **** {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] chap_username = {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87490]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cinder_internal_tenant_project_id = 4be693cd65c0470081998c14c97b9895 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cinder_internal_tenant_user_id = d3f7bd11bf8a438ebaffad8f0cffb382 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cluster = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] compression_format = gzip {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] compute_api_class = cinder.compute.nova.API {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] config_dir = [] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] config_source = [] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] control_exchange = openstack {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] debug = True {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] default_availability_zone = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] default_group_type = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] default_volume_type = QuobyteHD {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] disk_geometry = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] driver_client_cert = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] driver_client_cert_key = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] driver_data_namespace = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] driver_ssl_cert_path = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] driver_ssl_cert_verify = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] driver_use_ssl = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] enable_new_services = True {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] enable_unsupported_driver = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] enabled_backends = ['QuobyteHD'] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] enforce_multipath_for_image_xfer = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] filter_function = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] glance_api_insecure = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] glance_api_servers = ['http://192.168.122.230/image'] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] glance_api_ssl_compression = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] glance_ca_certificates_file = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] glance_catalog_info = image:glance:publicURL {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] glance_certfile = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] glance_keyfile = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] glance_num_retries = 3 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] glance_request_timeout = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] goodness_function = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] graceful_shutdown_timeout = 5 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] group_api_class = cinder.group.api.API {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] host = devstack {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] image_compress_on_upload = True {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] image_conversion_address_space_limit = 1 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] image_conversion_cpu_limit = 60 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] image_conversion_disable = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] image_upload_use_cinder_backend = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] image_upload_use_internal_tenant = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] image_volume_cache_enabled = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] image_volume_cache_max_count = 0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] image_volume_cache_max_size_gb = 0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] init_host_max_objects_retrieval = 0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] instance_format = [instance: %(uuid)s] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] iscsi_target_flags = {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] iscsi_write_cache = on {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] iser_helper = tgtadm {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] iser_ip_address = 192.168.122.230 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] iser_port = 3260 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] log_color = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] log_config_append = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] log_dir = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] log_file = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] log_options = True {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] log_rotate_interval = 1 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] log_rotate_interval_type = days {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] log_rotation_type = none {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] max_age = 0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] max_logfile_count = 30 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] max_logfile_size_mb = 200 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] max_over_subscription_ratio = 20.0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] message_reap_interval = 86400 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] message_ttl = 2592000 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] migration_create_volume_timeout_secs = 300 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] monkey_patch = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] monkey_patch_modules = [] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] my_ip = 192.168.122.230 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] no_snapshot_gb_quota = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] num_iser_scan_tries = 3 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] num_shell_tries = 3 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] num_volume_device_scan_tries = 3 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] nvmeof_conn_info_version = 1 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] nvmet_ns_id = 10 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] nvmet_port_id = 1 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] osapi_max_limit = 1000 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] osapi_volume_ext_list = [] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] osapi_volume_listen_port = 8776 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] osapi_volume_use_ssl = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] osapi_volume_workers = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] per_volume_size_limit = -1 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] periodic_fuzzy_delay = 60 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] periodic_interval = 60 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] public_endpoint = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] publish_errors = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] quota_backup_gigabytes = 1000 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] quota_backups = 10 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] quota_gigabytes = 1000 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] quota_groups = 10 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] quota_snapshots = 10 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] quota_volumes = 10 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] rate_limit_burst = 0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] rate_limit_except_level = CRITICAL {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] rate_limit_interval = 0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] reinit_driver_count = 3 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] replication_device = **** {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] report_discard_supported = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] report_interval = 120 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] reservation_clean_interval = 86400 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] reservation_expire = 86400 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] reserved_image_namespaces = [] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] reserved_percentage = 0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] rpc_response_timeout = 120 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] run_external_periodic_tasks = True {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] scst_target_driver = iscsi {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] scst_target_iqn_name = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] service_down_time = 720 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] shell_completion = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] snapshot_name_template = snapshot-%s {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] split_loggers = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] state_path = /opt/stack/data/cinder {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] storage_availability_zone = nova {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] storage_protocol = iSCSI {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] syslog_log_facility = LOG_USER {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] target_helper = lioadm {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] target_ip_address = 192.168.122.230 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] target_port = 3260 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] target_protocol = iscsi {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] target_secondary_ip_addresses = [] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] trace_flags = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] transport_url = **** {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] until_refresh = 0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] use_chap_auth = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] use_default_quota_class = True {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] use_journal = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] use_json = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Starting volume driver QuobyteDriver (1.2.1) Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] use_multipath_for_image_xfer = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87490) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] use_stderr = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] use_syslog = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] verify_glance_signatures = enabled {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] volume_api_class = cinder.volume.api.API {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] volume_backend_name = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] volume_clear = zero {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] volume_clear_ionice = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] volume_clear_size = 0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] volume_copy_bps_limit = 0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] volume_dd_blocksize = 1M {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] volume_name_template = volume-%s {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] volume_service_inithost_offload = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] volume_usage_audit_period = month {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] zoning_mode = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_concurrency.disable_process_locking = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.auth_section = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.auth_type = password {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.auth_version = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.cache = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.certfile = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.include_service_catalog = True {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.insecure = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.interface = public {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.keyfile = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.memcache_password = **** {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.memcache_username = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.region_name = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.service_type = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.230/identity {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.backend = dogpile.cache.null {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.backend_argument = **** {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.backend_expiration_time = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.config_prefix = cache.oslo {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.debug_cache_backend = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.enable_retry_client = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.enable_socket_keepalive = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.enabled = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.expiration_time = 600 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.hashclient_retry_attempts = 2 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.memcache_dead_retry = 300 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.memcache_pool_maxsize = 10 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.memcache_sasl_enabled = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.password = **** {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.proxies = [] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.redis_db = 0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.redis_server = localhost:6379 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.retry_attempts = 2 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.retry_delay = 0.0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.socket_keepalive_count = 1 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.socket_keepalive_idle = 1 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.socket_keepalive_interval = 1 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.socket_timeout = 1.0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.tls_allowed_ciphers = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.tls_cafile = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.tls_certfile = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.tls_enabled = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.tls_keyfile = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cache.username = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] coordination.backend_url = **** {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] database.asyncio_connection = **** {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] database.asyncio_slave_connection = **** {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] database.backend = sqlalchemy {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] database.connection = **** {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] database.connection_debug = 0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] database.connection_parameters = {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] database.connection_recycle_time = 3600 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] database.connection_trace = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] database.db_inc_retry_interval = True {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] database.db_max_retries = 20 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] database.db_max_retry_interval = 10 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] database.db_retry_interval = 1 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] database.max_overflow = 50 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] database.max_pool_size = 5 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] database.max_retries = 10 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] database.mysql_wsrep_sync_wait = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] database.pool_timeout = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] database.retry_interval = 10 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] database.slave_connection = **** {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] database.sqlite_synchronous = True {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] database.synchronous_reader = True {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] database.use_db_reconnect = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_tracing.insecure = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] profiler.connection_string = messaging:// {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] profiler.enabled = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] profiler.es_doc_type = notification {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] profiler.es_scroll_size = 10000 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] profiler.es_scroll_time = 2m {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] profiler.filter_error_trace = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] profiler.hmac_keys = **** {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] profiler.sentinel_service_name = mymaster {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] profiler.socket_timeout = 0.1 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] profiler.trace_requests = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] profiler.trace_sqlalchemy = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] profiler_jaeger.process_tags = {} {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] profiler_jaeger.service_name_prefix = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] profiler_otlp.service_name_prefix = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_policy.enforce_new_defaults = True {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_policy.policy_default_rule = default {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_policy.policy_file = policy.yaml {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] privsep_osbrick.group = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] privsep_osbrick.helper_command = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] privsep_osbrick.user = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cinder_sys_admin.group = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cinder_sys_admin.helper_command = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] cinder_sys_admin.user = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] service_user.auth_section = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] service_user.auth_type = password {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] service_user.cafile = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] service_user.certfile = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] service_user.collect_timing = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] service_user.insecure = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] service_user.keyfile = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] service_user.send_service_user_token = True {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] service_user.split_loggers = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] service_user.timeout = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] service_user.tls_ciphers = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] service_user.tls_min_version = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] glance.auth_section = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] glance.auth_type = password {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] glance.certfile = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] glance.collect_timing = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] glance.insecure = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] glance.keyfile = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] glance.region_name = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] glance.split_loggers = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] glance.timeout = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] glance.tls_ciphers = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] glance.tls_min_version = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.backend_availability_zone = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.chap_password = **** {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.chap_username = {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.disk_geometry = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.driver_client_cert = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.driver_client_cert_key = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.driver_data_namespace = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.driver_use_ssl = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.extra_capabilities = {} {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.filter_function = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.goodness_function = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87490) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 04 15:47:18 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.quobyte [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.iscsi_target_flags = {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.iscsi_write_cache = on {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.quobyte [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.iser_helper = tgtadm {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.iser_ip_address = 192.168.122.230 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.iser_port = 3260 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.nas_host = {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.nas_login = admin {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.nas_mount_options = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.nas_password = **** {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.nas_private_key = {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.nas_share_path = {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Running cmd (subprocess): mount.quobyte {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.num_shell_tries = 3 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.quobyte_volume_url = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.replication_device = **** {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.report_discard_supported = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.reserved_percentage = 0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.target_helper = tgtadm {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.target_ip_address = 192.168.122.230 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.target_port = 3260 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.target_protocol = iscsi {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.trace_flags = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.unique_fqdn_network = True {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.use_chap_auth = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.volume_backend_name = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.volume_clear = zero {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.volume_clear_ionice = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.volume_clear_size = 0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_reports.file_event_handler = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_reports.log_dir = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.backend_availability_zone = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.backend_host = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.chap_password = **** {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.chap_username = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.chiscsi_conf = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.disk_geometry = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.driver_client_cert = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.driver_data_namespace = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.driver_use_ssl = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.extra_capabilities = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.filter_function = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.goodness_function = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:18 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.iser_helper = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.iser_ip_address = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.iser_port = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.iser_target_prefix = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.nas_host = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.nas_login = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.nas_mount_options = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.nas_password = **** {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.nas_private_key = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.nas_share_path = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.nas_ssh_port = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.num_shell_tries = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.nvmet_port_id = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.replication_device = **** {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.report_discard_supported = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.reserved_percentage = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.scst_target_driver = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.storage_protocol = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.target_helper = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.target_ip_address = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.target_port = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.target_prefix = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.target_protocol = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.trace_flags = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.use_chap_auth = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack quobyte-client[87499]: Reading configuration file: /etc/quobyte/client.cfg Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.volume_clear = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.volume_clear_size = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack quobyte-client[87499]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 04 15:47:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] CMD "mount.quobyte" returned: 1 in 0.135s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:47:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] QuobyteHD.volumes_dir = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:47:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:47:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.ssl = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_notifications.driver = [] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_notifications.retry = -1 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] key_manager.fixed_key = **** {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican.barbican_api_version = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican.barbican_endpoint = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican.barbican_endpoint_type = public {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican.barbican_region_name = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican.cafile = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican.certfile = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican.collect_timing = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican.insecure = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican.keyfile = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican.number_of_retries = 60 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican.retry_delay = 1 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican.send_service_user_token = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican.split_loggers = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican.timeout = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican.tls_ciphers = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican.tls_min_version = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack sudo[87500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican.verify_ssl = True {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican.verify_ssl_path = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican_service_user.auth_section = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican_service_user.auth_type = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican_service_user.cafile = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican_service_user.certfile = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican_service_user.collect_timing = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican_service_user.insecure = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican_service_user.keyfile = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican_service_user.split_loggers = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican_service_user.timeout = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican_service_user.tls_ciphers = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] barbican_service_user.tls_min_version = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] vault.approle_role_id = **** {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] vault.approle_secret_id = **** {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] vault.auth_method = approle {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] vault.auth_path = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] vault.kv_mountpoint = secret {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] vault.kv_path = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] vault.kv_version = 2 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] vault.namespace = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] vault.root_token_id = **** {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] vault.ssl_ca_crt_file = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] vault.timeout = 60.0 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] vault.token_file = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] vault.token_role = None {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] vault.use_ssl = False {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 15:47:19 devstack cinder-volume[87187]: DEBUG oslo_service.backend._eventlet.service [None req-ea1a59f1-ca57-4ed1-be2b-f7144485b1d0 None None] ******************************************************************************** {{(pid=87187) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 04 15:47:19 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root Sep 04 15:47:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.509s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:47:19 devstack cinder-volume[87490]: INFO cinder.volume.driver [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Driver hasn't implemented _init_vendor_properties() Sep 04 15:47:19 devstack cinder-volume[87490]: DEBUG cinder.volume.driver [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7594451904297, 'free_capacity_gb': 1773.7594451904297, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87490) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 04 15:47:19 devstack cinder-volume[87490]: DEBUG oslo_db.sqlalchemy.engines [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87490) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 15:47:19 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writer thread running {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 15:47:19 devstack cinder-volume[87490]: DEBUG cinder.db.api [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Building query based on filter {{(pid=87490) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 04 15:47:19 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87490) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 04 15:47:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:47:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:47:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:47:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:47:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:47:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:47:19 devstack cinder-volume[87490]: INFO cinder.keymgr.migration [None req-708dd82a-5fd9-46af-9435-a48ee95094b8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 04 15:47:19 devstack sudo[87513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:47:19 devstack sudo[87513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:47:20 devstack sudo[87513]: pam_unix(sudo:session): session closed for user root Sep 04 15:47:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.610s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:47:20 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:47:20 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Driver initialization completed successfully. Sep 04 15:47:20 devstack cinder-volume[87490]: INFO cinder.manager [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Initiating service 3 cleanup Sep 04 15:47:20 devstack cinder-volume[87490]: INFO cinder.manager [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Service 3 cleanup completed. Sep 04 15:47:20 devstack cinder-volume[87490]: DEBUG cinder.service [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Creating RPC server for service cinder-volume {{(pid=87490) start /opt/stack/cinder/cinder/service.py:231}} Sep 04 15:47:20 devstack cinder-volume[87490]: DEBUG cinder.service [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87490) start /opt/stack/cinder/cinder/service.py:237}} Sep 04 15:47:20 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 04 15:47:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:47:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:47:20 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:47:20 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:47:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:47:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:47:20 devstack sudo[87527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:47:20 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:47:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-40be2675-f357-40fa-b1d9-fe0fd6808eef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:47:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-40be2675-f357-40fa-b1d9-fe0fd6808eef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:47:20 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-40be2675-f357-40fa-b1d9-fe0fd6808eef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:47:20 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-40be2675-f357-40fa-b1d9-fe0fd6808eef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:47:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-40be2675-f357-40fa-b1d9-fe0fd6808eef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:47:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-40be2675-f357-40fa-b1d9-fe0fd6808eef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:47:20 devstack sudo[87531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:47:20 devstack sudo[87531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:47:21 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root Sep 04 15:47:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.294s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:47:21 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-44a81086-9a3e-4eb4-a6f1-31b0763e54eb None None] Driver post RPC initialization completed successfully. Sep 04 15:47:21 devstack sudo[87531]: pam_unix(sudo:session): session closed for user root Sep 04 15:47:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-40be2675-f357-40fa-b1d9-fe0fd6808eef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.261s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:47:21 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-40be2675-f357-40fa-b1d9-fe0fd6808eef None None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:47:28 devstack cinder-volume[87187]: DEBUG dbcounter [-] [87187] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87187) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:47:30 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=2 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:47:31 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:47:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager._thread_info {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:47:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread count: 6 {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:47:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread info: [<_MainThread(MainThread, started 138899118923904)>, , , , , ] {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:48:21 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:48:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Flow 'volume_create_manager' (7b6116bc-d8ff-4d57-81a7-677453ee7a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:48:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d119bddc-d01a-49dc-b9a9-ab1f34e7bf1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d119bddc-d01a-49dc-b9a9-ab1f34e7bf1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-820119338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=285b6430-21ab-4b61-b19d-ab6f4ddc156a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='152ccb1f25f34fbb9da6f5218ff1e216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:48:22Z,use_quota=True,user_id='84a41410c7f34f82a6cb250b9bba8221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e548d65-ebad-4b31-99a2-653ed313f043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e548d65-ebad-4b31-99a2-653ed313f043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c821ae8b-054a-422e-bff3-db952609d16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c821ae8b-054a-422e-bff3-db952609d16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '285b6430-21ab-4b61-b19d-ab6f4ddc156a', 'volume_name': 'volume-285b6430-21ab-4b61-b19d-ab6f4ddc156a', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a994d5-c463-46dd-84f2-a5334918a853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a994d5-c463-46dd-84f2-a5334918a853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec4c357-9027-4af2-94ad-b8a35ae81392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:21 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Volume 285b6430-21ab-4b61-b19d-ab6f4ddc156a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-285b6430-21ab-4b61-b19d-ab6f4ddc156a', 'volume_size': 1} Sep 04 15:48:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:48:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:48:21 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-820119338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=285b6430-21ab-4b61-b19d-ab6f4ddc156a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='152ccb1f25f34fbb9da6f5218ff1e216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:48:22Z,use_quota=True,user_id='84a41410c7f34f82a6cb250b9bba8221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:48:21 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Creating volume 285b6430-21ab-4b61-b19d-ab6f4ddc156a {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:48:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:48:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:48:21 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:48:21 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:48:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:48:21 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:48:21 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:48:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-285b6430-21ab-4b61-b19d-ab6f4ddc156a 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:21 devstack sudo[88024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-285b6430-21ab-4b61-b19d-ab6f4ddc156a 1073741824 Sep 04 15:48:21 devstack sudo[88024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:22 devstack sudo[88024]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-285b6430-21ab-4b61-b19d-ab6f4ddc156a 1073741824" returned: 0 in 0.935s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-285b6430-21ab-4b61-b19d-ab6f4ddc156a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:22 devstack sudo[88367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-285b6430-21ab-4b61-b19d-ab6f4ddc156a Sep 04 15:48:22 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:23 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-285b6430-21ab-4b61-b19d-ab6f4ddc156a" returned: 0 in 0.309s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:23 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:48:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:48:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec4c357-9027-4af2-94ad-b8a35ae81392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-285b6430-21ab-4b61-b19d-ab6f4ddc156a', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a1ae79-48f4-483d-abf6-818a96618bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:23 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Volume volume-285b6430-21ab-4b61-b19d-ab6f4ddc156a (285b6430-21ab-4b61-b19d-ab6f4ddc156a): created successfully Sep 04 15:48:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a1ae79-48f4-483d-abf6-818a96618bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Flow 'volume_create_manager' (7b6116bc-d8ff-4d57-81a7-677453ee7a24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:48:23 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-d41f1fd0-a94a-4a50-997a-54055e1baec8 tempest-TaggedAttachmentsTest-875520799 None] Created volume successfully. Sep 04 15:48:31 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:48:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Flow 'volume_create_manager' (502b911b-d6ab-4e74-abd9-229035ec2639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:48:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c27b33-450f-4899-bfc3-6757676d98a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c27b33-450f-4899-bfc3-6757676d98a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1832566181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca40ad43-5cf6-48e5-9b5f-bca715d79fff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='551b4007c3144441819b467d987a6bfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:48:31Z,use_quota=True,user_id='4928aab700704b7faf6478f726bf7ce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (197879b8-23b9-43a3-8ccf-f2be3f9c0497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (197879b8-23b9-43a3-8ccf-f2be3f9c0497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (659c666c-b0f8-4d53-b024-da7bdd9f6b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (659c666c-b0f8-4d53-b024-da7bdd9f6b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca40ad43-5cf6-48e5-9b5f-bca715d79fff', 'volume_name': 'volume-ca40ad43-5cf6-48e5-9b5f-bca715d79fff', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f34974-953a-4117-956b-bf24afccefd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f34974-953a-4117-956b-bf24afccefd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d136859-0c45-4ae2-aaaf-f7a6a02ae0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:31 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Volume ca40ad43-5cf6-48e5-9b5f-bca715d79fff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca40ad43-5cf6-48e5-9b5f-bca715d79fff', 'volume_size': 1} Sep 04 15:48:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:48:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:48:31 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1832566181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca40ad43-5cf6-48e5-9b5f-bca715d79fff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='551b4007c3144441819b467d987a6bfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:48:31Z,use_quota=True,user_id='4928aab700704b7faf6478f726bf7ce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:48:31 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Creating volume ca40ad43-5cf6-48e5-9b5f-bca715d79fff {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:48:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:48:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:48:31 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:48:31 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:48:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:48:31 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:48:31 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:48:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ca40ad43-5cf6-48e5-9b5f-bca715d79fff 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:31 devstack sudo[88530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ca40ad43-5cf6-48e5-9b5f-bca715d79fff 1073741824 Sep 04 15:48:31 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:32 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ca40ad43-5cf6-48e5-9b5f-bca715d79fff 1073741824" returned: 0 in 0.788s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ca40ad43-5cf6-48e5-9b5f-bca715d79fff {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:32 devstack sudo[88549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ca40ad43-5cf6-48e5-9b5f-bca715d79fff Sep 04 15:48:32 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:32 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ca40ad43-5cf6-48e5-9b5f-bca715d79fff" returned: 0 in 0.604s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:48:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:48:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d136859-0c45-4ae2-aaaf-f7a6a02ae0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca40ad43-5cf6-48e5-9b5f-bca715d79fff', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (349fa268-ebec-4e98-95f5-78466a623211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:32 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Volume volume-ca40ad43-5cf6-48e5-9b5f-bca715d79fff (ca40ad43-5cf6-48e5-9b5f-bca715d79fff): created successfully Sep 04 15:48:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (349fa268-ebec-4e98-95f5-78466a623211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Flow 'volume_create_manager' (502b911b-d6ab-4e74-abd9-229035ec2639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:48:32 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-4fa643a9-a077-40a9-8104-7d0850977a79 tempest-DeleteServersTestJSON-369833361 None] Created volume successfully. Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:38 devstack sudo[88629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:48:38 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:38 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.471s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager._thread_info {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread count: 6 {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread info: [<_MainThread(MainThread, started 138899118923904)>, , , , , ] {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Flow 'volume_create_manager' (3f8c385f-e829-428e-ae02-2c80f8bf4f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab316360-8b70-4766-b893-d8ffc94a96a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab316360-8b70-4766-b893-d8ffc94a96a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-723149711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e934856-505e-4d14-9850-726358ce0d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='869ca63ef6934c01a369ce2ef02b2008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:48:39Z,use_quota=True,user_id='0040a30937954cb5a19594e73aa5ec91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e311d86-bfcd-427e-846e-624edc286372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e311d86-bfcd-427e-846e-624edc286372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d930c3f-159e-4f69-bdb9-7e85683ab881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d930c3f-159e-4f69-bdb9-7e85683ab881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e934856-505e-4d14-9850-726358ce0d0d', 'volume_name': 'volume-5e934856-505e-4d14-9850-726358ce0d0d', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e11d69-40a6-4a49-b01c-4dcad4084883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e11d69-40a6-4a49-b01c-4dcad4084883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f8b04a-73ed-4f10-861c-1872043f43bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:38 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Volume 5e934856-505e-4d14-9850-726358ce0d0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e934856-505e-4d14-9850-726358ce0d0d', 'volume_size': 1} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-723149711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e934856-505e-4d14-9850-726358ce0d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='869ca63ef6934c01a369ce2ef02b2008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:48:39Z,use_quota=True,user_id='0040a30937954cb5a19594e73aa5ec91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Creating volume 5e934856-505e-4d14-9850-726358ce0d0d {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:48:38 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:48:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5e934856-505e-4d14-9850-726358ce0d0d 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:38 devstack sudo[88634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5e934856-505e-4d14-9850-726358ce0d0d 1073741824 Sep 04 15:48:38 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:40 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5e934856-505e-4d14-9850-726358ce0d0d 1073741824" returned: 0 in 1.197s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5e934856-505e-4d14-9850-726358ce0d0d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:40 devstack sudo[88654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5e934856-505e-4d14-9850-726358ce0d0d Sep 04 15:48:40 devstack sudo[88654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:40 devstack sudo[88654]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5e934856-505e-4d14-9850-726358ce0d0d" returned: 0 in 0.583s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:40 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] <== create_volume: return (1981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:48:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.983s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:48:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f8b04a-73ed-4f10-861c-1872043f43bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e934856-505e-4d14-9850-726358ce0d0d', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3deff330-8269-4072-9d81-51ce672f93f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:48:40 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Volume volume-5e934856-505e-4d14-9850-726358ce0d0d (5e934856-505e-4d14-9850-726358ce0d0d): created successfully Sep 04 15:48:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3deff330-8269-4072-9d81-51ce672f93f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:48:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Flow 'volume_create_manager' (3f8c385f-e829-428e-ae02-2c80f8bf4f1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:48:41 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-02cf1d6b-41b7-46e8-b5c8-23f3593b1501 tempest-VolumesAdminNegativeTest-1036396125 None] Created volume successfully. Sep 04 15:48:41 devstack cinder-volume[87490]: WARNING py.warnings [req-d5acb42f-df1d-4e25-b4dc-c534fde02db3 req-1f25000b-28fd-48b2-9fc9-3136a6417d85 tempest-DeleteServersTestJSON-369833361 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 04 15:48:41 devstack cinder-volume[87490]: .first() Sep 04 15:48:41 devstack cinder-volume[87490]: Sep 04 15:48:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-d5acb42f-df1d-4e25-b4dc-c534fde02db3 req-1f25000b-28fd-48b2-9fc9-3136a6417d85 tempest-DeleteServersTestJSON-369833361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:48:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-d5acb42f-df1d-4e25-b4dc-c534fde02db3 req-1f25000b-28fd-48b2-9fc9-3136a6417d85 tempest-DeleteServersTestJSON-369833361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:48:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-d5acb42f-df1d-4e25-b4dc-c534fde02db3 req-1f25000b-28fd-48b2-9fc9-3136a6417d85 tempest-DeleteServersTestJSON-369833361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:48:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-d5acb42f-df1d-4e25-b4dc-c534fde02db3 req-1f25000b-28fd-48b2-9fc9-3136a6417d85 tempest-DeleteServersTestJSON-369833361 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787', 'name': 'volume-ca40ad43-5cf6-48e5-9b5f-bca715d79fff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ae08fdd2-e183-4ec6-98b3-c887ee310784', 'enforce_multipath': True} {{(pid=87490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:48:42 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-d5acb42f-df1d-4e25-b4dc-c534fde02db3 req-1f25000b-28fd-48b2-9fc9-3136a6417d85 tempest-DeleteServersTestJSON-369833361 None] attachment_update completed successfully. Sep 04 15:48:43 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5f00f7f0-bda5-4c8b-9762-df96ba20d506 tempest-VolumesAdminNegativeTest-1036396125 None] Acquiring lock "cinder-5e934856-505e-4d14-9850-726358ce0d0d-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:48:43 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5f00f7f0-bda5-4c8b-9762-df96ba20d506 tempest-VolumesAdminNegativeTest-1036396125 None] Lock "cinder-5e934856-505e-4d14-9850-726358ce0d0d-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:48:43 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5f00f7f0-bda5-4c8b-9762-df96ba20d506 tempest-VolumesAdminNegativeTest-1036396125 None] Acquiring lock "cinder-quobyte-5e934856-505e-4d14-9850-726358ce0d0d" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:48:43 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5f00f7f0-bda5-4c8b-9762-df96ba20d506 tempest-VolumesAdminNegativeTest-1036396125 None] Lock "cinder-quobyte-5e934856-505e-4d14-9850-726358ce0d0d" acquired by "delete_volume" :: waited 0.041s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:48:43 devstack cinder-volume[87490]: INFO oslo.privsep.daemon [None req-5f00f7f0-bda5-4c8b-9762-df96ba20d506 tempest-VolumesAdminNegativeTest-1036396125 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpz6uwlbu4/privsep.sock'] Sep 04 15:48:43 devstack sudo[88712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpz6uwlbu4/privsep.sock Sep 04 15:48:43 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:46 devstack cinder-volume[87490]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 04 15:48:46 devstack cinder-volume[87490]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 04 15:48:46 devstack cinder-volume[87490]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 04 15:48:46 devstack cinder-volume[87490]: WARNING oslo.privsep.daemon [-] privsep log: Sep 04 15:48:46 devstack cinder-volume[87490]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 04 15:48:46 devstack cinder-volume[87490]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 04 15:48:46 devstack cinder-volume[87490]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 04 15:48:46 devstack cinder-volume[87490]: WARNING oslo.privsep.daemon [-] privsep log: Sep 04 15:48:46 devstack cinder-volume[87490]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 04 15:48:46 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:46 devstack cinder-volume[87490]: INFO oslo.privsep.daemon [None req-5f00f7f0-bda5-4c8b-9762-df96ba20d506 tempest-VolumesAdminNegativeTest-1036396125 None] Spawned new privsep daemon via rootwrap Sep 04 15:48:46 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [None req-5f00f7f0-bda5-4c8b-9762-df96ba20d506 tempest-VolumesAdminNegativeTest-1036396125 None] Accepted privsep connection to /tmp/tmpz6uwlbu4/privsep.sock {{(pid=87490) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 04 15:48:46 devstack cinder-volume[87490]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 04 15:48:46 devstack cinder-volume[87490]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 04 15:48:46 devstack cinder-volume[87490]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 04 15:48:46 devstack cinder-volume[87490]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89119 Sep 04 15:48:46 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42f0990-7db6-483c-8d70-cda82028a53b]: (2,) {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:48:46 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[13afde62-6c1d-4eb8-b805-4e7d0459a5d8]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:48:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5f00f7f0-bda5-4c8b-9762-df96ba20d506 tempest-VolumesAdminNegativeTest-1036396125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5e934856-505e-4d14-9850-726358ce0d0d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:47 devstack sudo[89130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5e934856-505e-4d14-9850-726358ce0d0d Sep 04 15:48:47 devstack sudo[89130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:47 devstack sudo[89130]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5f00f7f0-bda5-4c8b-9762-df96ba20d506 tempest-VolumesAdminNegativeTest-1036396125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5e934856-505e-4d14-9850-726358ce0d0d" returned: 0 in 0.984s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5f00f7f0-bda5-4c8b-9762-df96ba20d506 tempest-VolumesAdminNegativeTest-1036396125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5e934856-505e-4d14-9850-726358ce0d0d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:47 devstack sudo[89175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5e934856-505e-4d14-9850-726358ce0d0d Sep 04 15:48:47 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:48 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5f00f7f0-bda5-4c8b-9762-df96ba20d506 tempest-VolumesAdminNegativeTest-1036396125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5e934856-505e-4d14-9850-726358ce0d0d" returned: 0 in 0.507s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:48 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5f00f7f0-bda5-4c8b-9762-df96ba20d506 tempest-VolumesAdminNegativeTest-1036396125 None] Lock "cinder-quobyte-5e934856-505e-4d14-9850-726358ce0d0d" released by "delete_volume" :: held 4.765s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:48:48 devstack cinder-volume[87490]: WARNING cinder.quota [None req-5f00f7f0-bda5-4c8b-9762-df96ba20d506 tempest-VolumesAdminNegativeTest-1036396125 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:48:48 devstack cinder-volume[87490]: WARNING cinder.quota [None req-5f00f7f0-bda5-4c8b-9762-df96ba20d506 tempest-VolumesAdminNegativeTest-1036396125 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:48:48 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-5f00f7f0-bda5-4c8b-9762-df96ba20d506 tempest-VolumesAdminNegativeTest-1036396125 None] Created reservations ['b7a717cc-6ebf-4133-9d63-7ab9790ee386', '4aae25c0-658c-4a37-b902-9a313b2f678e', '2889dd67-ef87-4504-9d05-06c261519ff6', '5bdecd6e-28cd-4e7d-a589-cbcd70e5fe85'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:48:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5f00f7f0-bda5-4c8b-9762-df96ba20d506 tempest-VolumesAdminNegativeTest-1036396125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:48:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5f00f7f0-bda5-4c8b-9762-df96ba20d506 tempest-VolumesAdminNegativeTest-1036396125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:48:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-5f00f7f0-bda5-4c8b-9762-df96ba20d506 tempest-VolumesAdminNegativeTest-1036396125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:48:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-5f00f7f0-bda5-4c8b-9762-df96ba20d506 tempest-VolumesAdminNegativeTest-1036396125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:48:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5f00f7f0-bda5-4c8b-9762-df96ba20d506 tempest-VolumesAdminNegativeTest-1036396125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:48:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5f00f7f0-bda5-4c8b-9762-df96ba20d506 tempest-VolumesAdminNegativeTest-1036396125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:48 devstack sudo[89180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:48:48 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:49 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5f00f7f0-bda5-4c8b-9762-df96ba20d506 tempest-VolumesAdminNegativeTest-1036396125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.580s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:49 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-5f00f7f0-bda5-4c8b-9762-df96ba20d506 tempest-VolumesAdminNegativeTest-1036396125 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:48:49 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-5f00f7f0-bda5-4c8b-9762-df96ba20d506 tempest-VolumesAdminNegativeTest-1036396125 None] Deleted volume successfully. Sep 04 15:48:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5f00f7f0-bda5-4c8b-9762-df96ba20d506 tempest-VolumesAdminNegativeTest-1036396125 None] Lock "cinder-5e934856-505e-4d14-9850-726358ce0d0d-delete_volume" released by "delete_volume" :: held 5.780s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:48:50 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-53481a05-f115-4a22-b2ec-2d3508b8ad15 req-b6006aa0-17b5-424f-8631-3c34e38b8fa0 tempest-DeleteServersTestJSON-369833361 None] Terminate volume connection completed successfully. Sep 04 15:48:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-53481a05-f115-4a22-b2ec-2d3508b8ad15 req-b6006aa0-17b5-424f-8631-3c34e38b8fa0 tempest-DeleteServersTestJSON-369833361 None] Deleting attachment ae08fdd2-e183-4ec6-98b3-c887ee310784. {{(pid=87490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:48:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c6d0c7a7-9d55-4a43-a087-c2505d4176f6 tempest-DeleteServersTestJSON-369833361 None] Acquiring lock "cinder-ca40ad43-5cf6-48e5-9b5f-bca715d79fff-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:48:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c6d0c7a7-9d55-4a43-a087-c2505d4176f6 tempest-DeleteServersTestJSON-369833361 None] Lock "cinder-ca40ad43-5cf6-48e5-9b5f-bca715d79fff-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:48:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c6d0c7a7-9d55-4a43-a087-c2505d4176f6 tempest-DeleteServersTestJSON-369833361 None] Acquiring lock "cinder-quobyte-ca40ad43-5cf6-48e5-9b5f-bca715d79fff" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:48:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c6d0c7a7-9d55-4a43-a087-c2505d4176f6 tempest-DeleteServersTestJSON-369833361 None] Lock "cinder-quobyte-ca40ad43-5cf6-48e5-9b5f-bca715d79fff" acquired by "delete_volume" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:48:53 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[9354ae9d-bb82-41b1-a81d-af213c8854e6]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:48:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c6d0c7a7-9d55-4a43-a087-c2505d4176f6 tempest-DeleteServersTestJSON-369833361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ca40ad43-5cf6-48e5-9b5f-bca715d79fff {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:53 devstack sudo[89211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ca40ad43-5cf6-48e5-9b5f-bca715d79fff Sep 04 15:48:53 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:53 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c6d0c7a7-9d55-4a43-a087-c2505d4176f6 tempest-DeleteServersTestJSON-369833361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ca40ad43-5cf6-48e5-9b5f-bca715d79fff" returned: 0 in 0.450s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c6d0c7a7-9d55-4a43-a087-c2505d4176f6 tempest-DeleteServersTestJSON-369833361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ca40ad43-5cf6-48e5-9b5f-bca715d79fff {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:53 devstack sudo[89216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ca40ad43-5cf6-48e5-9b5f-bca715d79fff Sep 04 15:48:53 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:53 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c6d0c7a7-9d55-4a43-a087-c2505d4176f6 tempest-DeleteServersTestJSON-369833361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ca40ad43-5cf6-48e5-9b5f-bca715d79fff" returned: 0 in 0.267s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c6d0c7a7-9d55-4a43-a087-c2505d4176f6 tempest-DeleteServersTestJSON-369833361 None] Lock "cinder-quobyte-ca40ad43-5cf6-48e5-9b5f-bca715d79fff" released by "delete_volume" :: held 0.794s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:48:53 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-c6d0c7a7-9d55-4a43-a087-c2505d4176f6 tempest-DeleteServersTestJSON-369833361 None] Created reservations ['bd209dad-1e7d-4ae4-875a-0bfcf623ddf0', '8cf41c90-c1f8-47a6-bf43-a2af05b86537', 'bc5a68b7-ad2d-4679-ac46-100b3b972a0f', '04ca8ce3-5519-415f-afa0-d6b00d50e21d'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:48:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c6d0c7a7-9d55-4a43-a087-c2505d4176f6 tempest-DeleteServersTestJSON-369833361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:48:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c6d0c7a7-9d55-4a43-a087-c2505d4176f6 tempest-DeleteServersTestJSON-369833361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:48:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c6d0c7a7-9d55-4a43-a087-c2505d4176f6 tempest-DeleteServersTestJSON-369833361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:48:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c6d0c7a7-9d55-4a43-a087-c2505d4176f6 tempest-DeleteServersTestJSON-369833361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:48:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c6d0c7a7-9d55-4a43-a087-c2505d4176f6 tempest-DeleteServersTestJSON-369833361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:48:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c6d0c7a7-9d55-4a43-a087-c2505d4176f6 tempest-DeleteServersTestJSON-369833361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:48:54 devstack sudo[89220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:48:54 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:48:54 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root Sep 04 15:48:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c6d0c7a7-9d55-4a43-a087-c2505d4176f6 tempest-DeleteServersTestJSON-369833361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.399s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:48:54 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-c6d0c7a7-9d55-4a43-a087-c2505d4176f6 tempest-DeleteServersTestJSON-369833361 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:48:54 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-c6d0c7a7-9d55-4a43-a087-c2505d4176f6 tempest-DeleteServersTestJSON-369833361 None] Deleted volume successfully. Sep 04 15:48:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c6d0c7a7-9d55-4a43-a087-c2505d4176f6 tempest-DeleteServersTestJSON-369833361 None] Lock "cinder-ca40ad43-5cf6-48e5-9b5f-bca715d79fff-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:49:04 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:UPDATE=31,cinder:SELECT=20,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:49:04 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=27,cinder:UPDATE=22,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:49:07 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:49:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Flow 'volume_create_manager' (dd3078d7-0696-486c-aad8-3072045f94c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:49:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08be57c9-6563-46b4-bab7-550a5eaabe6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08be57c9-6563-46b4-bab7-550a5eaabe6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1530558207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57cee1a7-b6e4-429d-9d69-f737e4002268,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b7bcc6d9c50462aa47f1219be83c719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:49:07Z,use_quota=True,user_id='60f3f740a2f94d78ad5daac1eaf8736b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5267fec-87ed-472a-8e86-c7cdf3ac0db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5267fec-87ed-472a-8e86-c7cdf3ac0db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db779fc6-f5e3-427b-a408-986fc358859e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db779fc6-f5e3-427b-a408-986fc358859e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57cee1a7-b6e4-429d-9d69-f737e4002268', 'volume_name': 'volume-57cee1a7-b6e4-429d-9d69-f737e4002268', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c8d8dfa-4502-4671-b3b3-24dafbbeac2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c8d8dfa-4502-4671-b3b3-24dafbbeac2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e8addf-0786-4a3c-bac9-66e55293ea9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:07 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Volume 57cee1a7-b6e4-429d-9d69-f737e4002268: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57cee1a7-b6e4-429d-9d69-f737e4002268', 'volume_size': 1} Sep 04 15:49:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:49:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:49:07 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1530558207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57cee1a7-b6e4-429d-9d69-f737e4002268,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b7bcc6d9c50462aa47f1219be83c719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:49:07Z,use_quota=True,user_id='60f3f740a2f94d78ad5daac1eaf8736b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:49:07 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Creating volume 57cee1a7-b6e4-429d-9d69-f737e4002268 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:49:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:49:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:49:07 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:49:07 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:49:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:49:07 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:49:07 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:49:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-57cee1a7-b6e4-429d-9d69-f737e4002268 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:07 devstack sudo[89263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-57cee1a7-b6e4-429d-9d69-f737e4002268 1073741824 Sep 04 15:49:07 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:08 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-57cee1a7-b6e4-429d-9d69-f737e4002268 1073741824" returned: 0 in 0.469s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-57cee1a7-b6e4-429d-9d69-f737e4002268 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:08 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-57cee1a7-b6e4-429d-9d69-f737e4002268 Sep 04 15:49:08 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:08 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-57cee1a7-b6e4-429d-9d69-f737e4002268" returned: 0 in 0.263s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:08 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:49:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:49:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e8addf-0786-4a3c-bac9-66e55293ea9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57cee1a7-b6e4-429d-9d69-f737e4002268', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853d4583-8f04-4afd-b11e-018c4bdec4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:08 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Volume volume-57cee1a7-b6e4-429d-9d69-f737e4002268 (57cee1a7-b6e4-429d-9d69-f737e4002268): created successfully Sep 04 15:49:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853d4583-8f04-4afd-b11e-018c4bdec4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Flow 'volume_create_manager' (dd3078d7-0696-486c-aad8-3072045f94c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:49:08 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-637a29cc-6d06-4a6a-8c24-817b2b4023d3 tempest-VolumesTestJSON-224875339 None] Created volume successfully. Sep 04 15:49:10 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:49:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Flow 'volume_create_manager' (99ce236c-9d12-44d7-a630-bffb4167233d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:49:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9851e49-bf0b-432e-ace5-e3a114a5134a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9851e49-bf0b-432e-ace5-e3a114a5134a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1139039567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ab0aba-cf2d-4d5a-a116-f97a0f2e974a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b7bcc6d9c50462aa47f1219be83c719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:49:10Z,use_quota=True,user_id='60f3f740a2f94d78ad5daac1eaf8736b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16547956-360d-4835-82e3-90b13201c8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16547956-360d-4835-82e3-90b13201c8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f45b881-14d5-428e-a4c2-c50c738f8be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f45b881-14d5-428e-a4c2-c50c738f8be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37ab0aba-cf2d-4d5a-a116-f97a0f2e974a', 'volume_name': 'volume-37ab0aba-cf2d-4d5a-a116-f97a0f2e974a', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c46e59-9293-4a71-bd96-fab3e87202c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c46e59-9293-4a71-bd96-fab3e87202c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd90557-623d-4de6-a3e9-68000c2eb2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:10 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Volume 37ab0aba-cf2d-4d5a-a116-f97a0f2e974a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37ab0aba-cf2d-4d5a-a116-f97a0f2e974a', 'volume_size': 1} Sep 04 15:49:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:49:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:49:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1139039567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ab0aba-cf2d-4d5a-a116-f97a0f2e974a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b7bcc6d9c50462aa47f1219be83c719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:49:10Z,use_quota=True,user_id='60f3f740a2f94d78ad5daac1eaf8736b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:49:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Creating volume 37ab0aba-cf2d-4d5a-a116-f97a0f2e974a {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:49:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:49:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:49:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:49:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:49:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:49:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:49:10 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:49:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-37ab0aba-cf2d-4d5a-a116-f97a0f2e974a 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:10 devstack sudo[89276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-37ab0aba-cf2d-4d5a-a116-f97a0f2e974a 1073741824 Sep 04 15:49:10 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:10 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-37ab0aba-cf2d-4d5a-a116-f97a0f2e974a 1073741824" returned: 0 in 0.595s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-37ab0aba-cf2d-4d5a-a116-f97a0f2e974a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:10 devstack sudo[89284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-37ab0aba-cf2d-4d5a-a116-f97a0f2e974a Sep 04 15:49:10 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:11 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-37ab0aba-cf2d-4d5a-a116-f97a0f2e974a" returned: 0 in 0.272s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:11 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:49:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:49:11 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd90557-623d-4de6-a3e9-68000c2eb2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37ab0aba-cf2d-4d5a-a116-f97a0f2e974a', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:11 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c04dd6-ecb2-48cb-9f3c-51221df68f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:11 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Volume volume-37ab0aba-cf2d-4d5a-a116-f97a0f2e974a (37ab0aba-cf2d-4d5a-a116-f97a0f2e974a): created successfully Sep 04 15:49:11 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c04dd6-ecb2-48cb-9f3c-51221df68f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:11 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Flow 'volume_create_manager' (99ce236c-9d12-44d7-a630-bffb4167233d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:49:11 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-eb411edc-093d-4a81-9b0a-30f9bea93b81 tempest-VolumesTestJSON-224875339 None] Created volume successfully. Sep 04 15:49:13 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:49:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Flow 'volume_create_manager' (c15b3645-2885-4f35-a7bb-e87665e8cf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:49:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad48c502-3cbe-41a3-b028-a98f8e9a182e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad48c502-3cbe-41a3-b028-a98f8e9a182e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1038029869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21be1ba9-6b4d-4280-bb86-a089cfc4deb7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b7bcc6d9c50462aa47f1219be83c719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:49:13Z,use_quota=True,user_id='60f3f740a2f94d78ad5daac1eaf8736b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9add70d-1cb7-4199-987c-1bd82bbd52e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9add70d-1cb7-4199-987c-1bd82bbd52e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38bc67e3-ce5b-4673-9339-f95e3d08d885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38bc67e3-ce5b-4673-9339-f95e3d08d885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21be1ba9-6b4d-4280-bb86-a089cfc4deb7', 'volume_name': 'volume-21be1ba9-6b4d-4280-bb86-a089cfc4deb7', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdb4286-52ed-4a00-baa1-a207f0bff265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdb4286-52ed-4a00-baa1-a207f0bff265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd9f54cc-47ca-42ea-926a-0e98414f8583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:13 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Volume 21be1ba9-6b4d-4280-bb86-a089cfc4deb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21be1ba9-6b4d-4280-bb86-a089cfc4deb7', 'volume_size': 1} Sep 04 15:49:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:49:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:49:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1038029869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21be1ba9-6b4d-4280-bb86-a089cfc4deb7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b7bcc6d9c50462aa47f1219be83c719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:49:13Z,use_quota=True,user_id='60f3f740a2f94d78ad5daac1eaf8736b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:49:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Creating volume 21be1ba9-6b4d-4280-bb86-a089cfc4deb7 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:49:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:49:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:49:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:49:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:49:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:49:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:49:13 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:49:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-21be1ba9-6b4d-4280-bb86-a089cfc4deb7 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:13 devstack sudo[89288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-21be1ba9-6b4d-4280-bb86-a089cfc4deb7 1073741824 Sep 04 15:49:13 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:13 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-21be1ba9-6b4d-4280-bb86-a089cfc4deb7 1073741824" returned: 0 in 0.723s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-21be1ba9-6b4d-4280-bb86-a089cfc4deb7 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:13 devstack sudo[89294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-21be1ba9-6b4d-4280-bb86-a089cfc4deb7 Sep 04 15:49:13 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:14 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-21be1ba9-6b4d-4280-bb86-a089cfc4deb7" returned: 0 in 0.411s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:49:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:49:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd9f54cc-47ca-42ea-926a-0e98414f8583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21be1ba9-6b4d-4280-bb86-a089cfc4deb7', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64a0506-b1c9-4d34-8f4a-a66e50035fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:49:14 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Volume volume-21be1ba9-6b4d-4280-bb86-a089cfc4deb7 (21be1ba9-6b4d-4280-bb86-a089cfc4deb7): created successfully Sep 04 15:49:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64a0506-b1c9-4d34-8f4a-a66e50035fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:49:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Flow 'volume_create_manager' (c15b3645-2885-4f35-a7bb-e87665e8cf88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:49:14 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-46175854-8fda-4061-95dd-23276d3565a2 tempest-VolumesTestJSON-224875339 None] Created volume successfully. Sep 04 15:49:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d510e786-a562-45e4-ac79-849f0e5ffa76 tempest-VolumesTestJSON-224875339 None] Acquiring lock "cinder-21be1ba9-6b4d-4280-bb86-a089cfc4deb7-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:49:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d510e786-a562-45e4-ac79-849f0e5ffa76 tempest-VolumesTestJSON-224875339 None] Lock "cinder-21be1ba9-6b4d-4280-bb86-a089cfc4deb7-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:49:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d510e786-a562-45e4-ac79-849f0e5ffa76 tempest-VolumesTestJSON-224875339 None] Acquiring lock "cinder-quobyte-21be1ba9-6b4d-4280-bb86-a089cfc4deb7" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:49:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d510e786-a562-45e4-ac79-849f0e5ffa76 tempest-VolumesTestJSON-224875339 None] Lock "cinder-quobyte-21be1ba9-6b4d-4280-bb86-a089cfc4deb7" acquired by "delete_volume" :: waited 0.020s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:49:16 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[f249481e-e18a-4c6e-bac7-6a137f981b02]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:49:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d510e786-a562-45e4-ac79-849f0e5ffa76 tempest-VolumesTestJSON-224875339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-21be1ba9-6b4d-4280-bb86-a089cfc4deb7 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:16 devstack sudo[89306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-21be1ba9-6b4d-4280-bb86-a089cfc4deb7 Sep 04 15:49:16 devstack sudo[89306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:17 devstack sudo[89306]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d510e786-a562-45e4-ac79-849f0e5ffa76 tempest-VolumesTestJSON-224875339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-21be1ba9-6b4d-4280-bb86-a089cfc4deb7" returned: 0 in 0.647s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d510e786-a562-45e4-ac79-849f0e5ffa76 tempest-VolumesTestJSON-224875339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-21be1ba9-6b4d-4280-bb86-a089cfc4deb7 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:17 devstack sudo[89344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-21be1ba9-6b4d-4280-bb86-a089cfc4deb7 Sep 04 15:49:17 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:17 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d510e786-a562-45e4-ac79-849f0e5ffa76 tempest-VolumesTestJSON-224875339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-21be1ba9-6b4d-4280-bb86-a089cfc4deb7" returned: 0 in 0.273s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:17 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d510e786-a562-45e4-ac79-849f0e5ffa76 tempest-VolumesTestJSON-224875339 None] Lock "cinder-quobyte-21be1ba9-6b4d-4280-bb86-a089cfc4deb7" released by "delete_volume" :: held 0.973s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:49:17 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-d510e786-a562-45e4-ac79-849f0e5ffa76 tempest-VolumesTestJSON-224875339 None] Created reservations ['9206af93-f279-4477-ab80-a05e7fccb56c', 'f8aa04e9-9c4b-43f9-b5c6-fea28c9f3b98', '396f849a-d03d-4647-9de8-8489d2807055', 'bfc4d69f-5885-461a-817b-dd5afb8201f9'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:49:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d510e786-a562-45e4-ac79-849f0e5ffa76 tempest-VolumesTestJSON-224875339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:49:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d510e786-a562-45e4-ac79-849f0e5ffa76 tempest-VolumesTestJSON-224875339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:49:17 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d510e786-a562-45e4-ac79-849f0e5ffa76 tempest-VolumesTestJSON-224875339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:49:17 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d510e786-a562-45e4-ac79-849f0e5ffa76 tempest-VolumesTestJSON-224875339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:49:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d510e786-a562-45e4-ac79-849f0e5ffa76 tempest-VolumesTestJSON-224875339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:49:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d510e786-a562-45e4-ac79-849f0e5ffa76 tempest-VolumesTestJSON-224875339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:17 devstack sudo[89347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:49:17 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:18 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d510e786-a562-45e4-ac79-849f0e5ffa76 tempest-VolumesTestJSON-224875339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.369s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:18 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d510e786-a562-45e4-ac79-849f0e5ffa76 tempest-VolumesTestJSON-224875339 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:49:18 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-d510e786-a562-45e4-ac79-849f0e5ffa76 tempest-VolumesTestJSON-224875339 None] Deleted volume successfully. Sep 04 15:49:18 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d510e786-a562-45e4-ac79-849f0e5ffa76 tempest-VolumesTestJSON-224875339 None] Lock "cinder-21be1ba9-6b4d-4280-bb86-a089cfc4deb7-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:49:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-172b2509-9694-46cd-b742-7f6ebfdc61d5 tempest-VolumesTestJSON-224875339 None] Acquiring lock "cinder-37ab0aba-cf2d-4d5a-a116-f97a0f2e974a-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:49:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-172b2509-9694-46cd-b742-7f6ebfdc61d5 tempest-VolumesTestJSON-224875339 None] Lock "cinder-37ab0aba-cf2d-4d5a-a116-f97a0f2e974a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:49:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-172b2509-9694-46cd-b742-7f6ebfdc61d5 tempest-VolumesTestJSON-224875339 None] Acquiring lock "cinder-quobyte-37ab0aba-cf2d-4d5a-a116-f97a0f2e974a" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:49:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-172b2509-9694-46cd-b742-7f6ebfdc61d5 tempest-VolumesTestJSON-224875339 None] Lock "cinder-quobyte-37ab0aba-cf2d-4d5a-a116-f97a0f2e974a" acquired by "delete_volume" :: waited 0.031s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:49:19 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27d7bc2-fe23-420a-8767-7ce7a66d7e04]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:49:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-172b2509-9694-46cd-b742-7f6ebfdc61d5 tempest-VolumesTestJSON-224875339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-37ab0aba-cf2d-4d5a-a116-f97a0f2e974a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:19 devstack sudo[89395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-37ab0aba-cf2d-4d5a-a116-f97a0f2e974a Sep 04 15:49:19 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:19 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-172b2509-9694-46cd-b742-7f6ebfdc61d5 tempest-VolumesTestJSON-224875339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-37ab0aba-cf2d-4d5a-a116-f97a0f2e974a" returned: 0 in 0.610s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-172b2509-9694-46cd-b742-7f6ebfdc61d5 tempest-VolumesTestJSON-224875339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-37ab0aba-cf2d-4d5a-a116-f97a0f2e974a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:19 devstack sudo[89415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-37ab0aba-cf2d-4d5a-a116-f97a0f2e974a Sep 04 15:49:19 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:20 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-172b2509-9694-46cd-b742-7f6ebfdc61d5 tempest-VolumesTestJSON-224875339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-37ab0aba-cf2d-4d5a-a116-f97a0f2e974a" returned: 0 in 0.403s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:20 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-172b2509-9694-46cd-b742-7f6ebfdc61d5 tempest-VolumesTestJSON-224875339 None] Lock "cinder-quobyte-37ab0aba-cf2d-4d5a-a116-f97a0f2e974a" released by "delete_volume" :: held 1.102s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:49:20 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-172b2509-9694-46cd-b742-7f6ebfdc61d5 tempest-VolumesTestJSON-224875339 None] Created reservations ['d8537739-788f-4bae-885b-6aa9e78d4481', '9330bc7d-f3e6-4213-a06a-fada82fc7cdb', 'e0079fdf-2330-40db-9feb-520cae3a2ad2', '72fdeb1f-5984-48d2-82c0-605b6d3e007c'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:49:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-172b2509-9694-46cd-b742-7f6ebfdc61d5 tempest-VolumesTestJSON-224875339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:49:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-172b2509-9694-46cd-b742-7f6ebfdc61d5 tempest-VolumesTestJSON-224875339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:49:20 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-172b2509-9694-46cd-b742-7f6ebfdc61d5 tempest-VolumesTestJSON-224875339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:49:20 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-172b2509-9694-46cd-b742-7f6ebfdc61d5 tempest-VolumesTestJSON-224875339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:49:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-172b2509-9694-46cd-b742-7f6ebfdc61d5 tempest-VolumesTestJSON-224875339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:49:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-172b2509-9694-46cd-b742-7f6ebfdc61d5 tempest-VolumesTestJSON-224875339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:20 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:49:20 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:20 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-172b2509-9694-46cd-b742-7f6ebfdc61d5 tempest-VolumesTestJSON-224875339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.421s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:20 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-172b2509-9694-46cd-b742-7f6ebfdc61d5 tempest-VolumesTestJSON-224875339 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:49:20 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-172b2509-9694-46cd-b742-7f6ebfdc61d5 tempest-VolumesTestJSON-224875339 None] Deleted volume successfully. Sep 04 15:49:20 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-172b2509-9694-46cd-b742-7f6ebfdc61d5 tempest-VolumesTestJSON-224875339 None] Lock "cinder-37ab0aba-cf2d-4d5a-a116-f97a0f2e974a-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:49:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-f9b224f4-5d1f-496a-aaf1-c1aa9cecff2c req-42f4f4fb-03ac-4217-aea3-10c6472fe705 tempest-TaggedAttachmentsTest-875520799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:49:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-f9b224f4-5d1f-496a-aaf1-c1aa9cecff2c req-42f4f4fb-03ac-4217-aea3-10c6472fe705 tempest-TaggedAttachmentsTest-875520799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:49:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-27884958-acec-4c7d-b4f0-9e5c02e5aee7 tempest-VolumesTestJSON-224875339 None] Acquiring lock "cinder-57cee1a7-b6e4-429d-9d69-f737e4002268-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:49:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-f9b224f4-5d1f-496a-aaf1-c1aa9cecff2c req-42f4f4fb-03ac-4217-aea3-10c6472fe705 tempest-TaggedAttachmentsTest-875520799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:49:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-27884958-acec-4c7d-b4f0-9e5c02e5aee7 tempest-VolumesTestJSON-224875339 None] Lock "cinder-57cee1a7-b6e4-429d-9d69-f737e4002268-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:49:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-f9b224f4-5d1f-496a-aaf1-c1aa9cecff2c req-42f4f4fb-03ac-4217-aea3-10c6472fe705 tempest-TaggedAttachmentsTest-875520799 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787', 'name': 'volume-285b6430-21ab-4b61-b19d-ab6f4ddc156a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b409b99-d867-430b-8f06-9c8a3cf3c946', 'enforce_multipath': True} {{(pid=87490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:49:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-27884958-acec-4c7d-b4f0-9e5c02e5aee7 tempest-VolumesTestJSON-224875339 None] Acquiring lock "cinder-quobyte-57cee1a7-b6e4-429d-9d69-f737e4002268" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:49:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-27884958-acec-4c7d-b4f0-9e5c02e5aee7 tempest-VolumesTestJSON-224875339 None] Lock "cinder-quobyte-57cee1a7-b6e4-429d-9d69-f737e4002268" acquired by "delete_volume" :: waited 0.029s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:49:21 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[32562f33-4a93-4c2c-a819-1e97413f6817]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:49:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-27884958-acec-4c7d-b4f0-9e5c02e5aee7 tempest-VolumesTestJSON-224875339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-57cee1a7-b6e4-429d-9d69-f737e4002268 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:21 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-f9b224f4-5d1f-496a-aaf1-c1aa9cecff2c req-42f4f4fb-03ac-4217-aea3-10c6472fe705 tempest-TaggedAttachmentsTest-875520799 None] attachment_update completed successfully. Sep 04 15:49:21 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-57cee1a7-b6e4-429d-9d69-f737e4002268 Sep 04 15:49:21 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:22 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-27884958-acec-4c7d-b4f0-9e5c02e5aee7 tempest-VolumesTestJSON-224875339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-57cee1a7-b6e4-429d-9d69-f737e4002268" returned: 0 in 0.515s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-27884958-acec-4c7d-b4f0-9e5c02e5aee7 tempest-VolumesTestJSON-224875339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-57cee1a7-b6e4-429d-9d69-f737e4002268 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:22 devstack sudo[89833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-57cee1a7-b6e4-429d-9d69-f737e4002268 Sep 04 15:49:22 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:22 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-27884958-acec-4c7d-b4f0-9e5c02e5aee7 tempest-VolumesTestJSON-224875339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-57cee1a7-b6e4-429d-9d69-f737e4002268" returned: 0 in 0.375s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-27884958-acec-4c7d-b4f0-9e5c02e5aee7 tempest-VolumesTestJSON-224875339 None] Lock "cinder-quobyte-57cee1a7-b6e4-429d-9d69-f737e4002268" released by "delete_volume" :: held 0.968s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:49:22 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-27884958-acec-4c7d-b4f0-9e5c02e5aee7 tempest-VolumesTestJSON-224875339 None] Created reservations ['b19e7d60-2cf5-4e21-b359-bb5beba3dfe9', 'afc27708-36c7-42a9-afa4-2ac1c95f7036', 'e72967de-19a1-4b88-bb5e-c7787ab71f66', 'c51b2ced-2d10-434f-aaa9-7eca499b40ea'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:49:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-27884958-acec-4c7d-b4f0-9e5c02e5aee7 tempest-VolumesTestJSON-224875339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:49:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-27884958-acec-4c7d-b4f0-9e5c02e5aee7 tempest-VolumesTestJSON-224875339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:49:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-27884958-acec-4c7d-b4f0-9e5c02e5aee7 tempest-VolumesTestJSON-224875339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:49:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-27884958-acec-4c7d-b4f0-9e5c02e5aee7 tempest-VolumesTestJSON-224875339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:49:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-27884958-acec-4c7d-b4f0-9e5c02e5aee7 tempest-VolumesTestJSON-224875339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:49:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-27884958-acec-4c7d-b4f0-9e5c02e5aee7 tempest-VolumesTestJSON-224875339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:22 devstack sudo[89839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:49:22 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:23 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-27884958-acec-4c7d-b4f0-9e5c02e5aee7 tempest-VolumesTestJSON-224875339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.319s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:23 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-27884958-acec-4c7d-b4f0-9e5c02e5aee7 tempest-VolumesTestJSON-224875339 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:49:23 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-27884958-acec-4c7d-b4f0-9e5c02e5aee7 tempest-VolumesTestJSON-224875339 None] Deleted volume successfully. Sep 04 15:49:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-27884958-acec-4c7d-b4f0-9e5c02e5aee7 tempest-VolumesTestJSON-224875339 None] Lock "cinder-57cee1a7-b6e4-429d-9d69-f737e4002268-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:49:28 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-cc877735-38cf-45ed-bd4d-02e3b7ab18f8 req-dbce4bf9-52f6-4549-93c8-ddf1d21a1e9e tempest-TaggedAttachmentsTest-875520799 None] Terminate volume connection completed successfully. Sep 04 15:49:28 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-cc877735-38cf-45ed-bd4d-02e3b7ab18f8 req-dbce4bf9-52f6-4549-93c8-ddf1d21a1e9e tempest-TaggedAttachmentsTest-875520799 None] Deleting attachment 2b409b99-d867-430b-8f06-9c8a3cf3c946. {{(pid=87490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:49:37 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-92a49091-b6c5-4113-9719-cdd0d85286c7 tempest-BackendsCapabilitiesAdminTestsJSON-222184632 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7594451904297, 'free_capacity_gb': 1773.7594451904297, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87490) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 04 15:49:38 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:UPDATE=34,cinder:SELECT=30,cinder:DELETE=1,cinder:INSERT=5 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:49:38 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=28,cinder:UPDATE=36,cinder:INSERT=10,cinder:DELETE=5 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:49:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-80e8b9ed-4e60-46f6-845d-830691a8b473 tempest-BackendsCapabilitiesAdminTestsJSON-222184632 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7594451904297, 'free_capacity_gb': 1773.7594451904297, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87490) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 04 15:49:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:49:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:49:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:49:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:49:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:49:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:49:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:38 devstack sudo[90038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:49:38 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:38 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.477s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:38 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:49:44 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ee0c8f3d-bf15-4f3d-ae7f-a8aca98ba768 tempest-TaggedAttachmentsTest-875520799 None] Acquiring lock "cinder-285b6430-21ab-4b61-b19d-ab6f4ddc156a-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:49:45 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ee0c8f3d-bf15-4f3d-ae7f-a8aca98ba768 tempest-TaggedAttachmentsTest-875520799 None] Lock "cinder-285b6430-21ab-4b61-b19d-ab6f4ddc156a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:49:45 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ee0c8f3d-bf15-4f3d-ae7f-a8aca98ba768 tempest-TaggedAttachmentsTest-875520799 None] Acquiring lock "cinder-quobyte-285b6430-21ab-4b61-b19d-ab6f4ddc156a" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:49:45 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ee0c8f3d-bf15-4f3d-ae7f-a8aca98ba768 tempest-TaggedAttachmentsTest-875520799 None] Lock "cinder-quobyte-285b6430-21ab-4b61-b19d-ab6f4ddc156a" acquired by "delete_volume" :: waited 0.033s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:49:45 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6527b9-fca1-4d00-90d4-d070e3ea8055]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:49:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ee0c8f3d-bf15-4f3d-ae7f-a8aca98ba768 tempest-TaggedAttachmentsTest-875520799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-285b6430-21ab-4b61-b19d-ab6f4ddc156a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:45 devstack sudo[90129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-285b6430-21ab-4b61-b19d-ab6f4ddc156a Sep 04 15:49:45 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:46 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ee0c8f3d-bf15-4f3d-ae7f-a8aca98ba768 tempest-TaggedAttachmentsTest-875520799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-285b6430-21ab-4b61-b19d-ab6f4ddc156a" returned: 0 in 0.903s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ee0c8f3d-bf15-4f3d-ae7f-a8aca98ba768 tempest-TaggedAttachmentsTest-875520799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-285b6430-21ab-4b61-b19d-ab6f4ddc156a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:46 devstack sudo[90137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-285b6430-21ab-4b61-b19d-ab6f4ddc156a Sep 04 15:49:46 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:46 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ee0c8f3d-bf15-4f3d-ae7f-a8aca98ba768 tempest-TaggedAttachmentsTest-875520799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-285b6430-21ab-4b61-b19d-ab6f4ddc156a" returned: 0 in 0.425s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:46 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ee0c8f3d-bf15-4f3d-ae7f-a8aca98ba768 tempest-TaggedAttachmentsTest-875520799 None] Lock "cinder-quobyte-285b6430-21ab-4b61-b19d-ab6f4ddc156a" released by "delete_volume" :: held 1.407s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:49:46 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-ee0c8f3d-bf15-4f3d-ae7f-a8aca98ba768 tempest-TaggedAttachmentsTest-875520799 None] Created reservations ['33d04fc2-b066-4f21-9d27-84eb1e41c877', '65a09194-266a-4eb7-a580-cce4fde2cea5', 'd4158cf0-e315-44a6-8075-b78f4ec56b60', 'cbb33dfe-4523-48f9-ae2a-4bc9c96d61d5'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:49:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ee0c8f3d-bf15-4f3d-ae7f-a8aca98ba768 tempest-TaggedAttachmentsTest-875520799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:49:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ee0c8f3d-bf15-4f3d-ae7f-a8aca98ba768 tempest-TaggedAttachmentsTest-875520799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:49:46 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ee0c8f3d-bf15-4f3d-ae7f-a8aca98ba768 tempest-TaggedAttachmentsTest-875520799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:49:46 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ee0c8f3d-bf15-4f3d-ae7f-a8aca98ba768 tempest-TaggedAttachmentsTest-875520799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:49:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ee0c8f3d-bf15-4f3d-ae7f-a8aca98ba768 tempest-TaggedAttachmentsTest-875520799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:49:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ee0c8f3d-bf15-4f3d-ae7f-a8aca98ba768 tempest-TaggedAttachmentsTest-875520799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:46 devstack sudo[90141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:49:46 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:47 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ee0c8f3d-bf15-4f3d-ae7f-a8aca98ba768 tempest-TaggedAttachmentsTest-875520799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.328s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:47 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-ee0c8f3d-bf15-4f3d-ae7f-a8aca98ba768 tempest-TaggedAttachmentsTest-875520799 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:49:47 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-ee0c8f3d-bf15-4f3d-ae7f-a8aca98ba768 tempest-TaggedAttachmentsTest-875520799 None] Deleted volume successfully. Sep 04 15:49:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ee0c8f3d-bf15-4f3d-ae7f-a8aca98ba768 tempest-TaggedAttachmentsTest-875520799 None] Lock "cinder-285b6430-21ab-4b61-b19d-ab6f4ddc156a-delete_volume" released by "delete_volume" :: held 2.129s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:49:55 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-7b17fd46-e729-4c53-9301-2d43038c2b35 tempest-GroupsV320Test-613210995 None] Group tempest-GroupsV320Test-Group-1850051030: creating Sep 04 15:49:55 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-7b17fd46-e729-4c53-9301-2d43038c2b35 tempest-GroupsV320Test-613210995 None] Group tempest-GroupsV320Test-Group-1850051030: created successfully Sep 04 15:49:55 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-7b17fd46-e729-4c53-9301-2d43038c2b35 tempest-GroupsV320Test-613210995 None] Create group completed successfully. Sep 04 15:49:57 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-aa1df9f5-676d-4436-afea-0d8afb2775e0 tempest-GroupsV320Test-613210995 None] Created reservations ['a4c1acd9-f7b8-4dc2-8d56-9b5a64215e4e'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:49:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-aa1df9f5-676d-4436-afea-0d8afb2775e0 tempest-GroupsV320Test-613210995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:49:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-aa1df9f5-676d-4436-afea-0d8afb2775e0 tempest-GroupsV320Test-613210995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:49:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-aa1df9f5-676d-4436-afea-0d8afb2775e0 tempest-GroupsV320Test-613210995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:49:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-aa1df9f5-676d-4436-afea-0d8afb2775e0 tempest-GroupsV320Test-613210995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:49:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-aa1df9f5-676d-4436-afea-0d8afb2775e0 tempest-GroupsV320Test-613210995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:49:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-aa1df9f5-676d-4436-afea-0d8afb2775e0 tempest-GroupsV320Test-613210995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:49:57 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:49:57 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:49:58 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Sep 04 15:49:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-aa1df9f5-676d-4436-afea-0d8afb2775e0 tempest-GroupsV320Test-613210995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.722s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:49:58 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-aa1df9f5-676d-4436-afea-0d8afb2775e0 tempest-GroupsV320Test-613210995 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:49:58 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-aa1df9f5-676d-4436-afea-0d8afb2775e0 tempest-GroupsV320Test-613210995 None] Delete group completed successfully. Sep 04 15:50:03 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:50:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Flow 'volume_create_manager' (37e8c676-9af8-48c6-bc3e-3ba324283772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3703bc3-db97-47f6-b3f6-05c53df1919b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3703bc3-db97-47f6-b3f6-05c53df1919b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1924996578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e89698b-eada-4dc8-8585-483e23a25218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48f17c11f72e403a8d805da13bff5d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:03Z,use_quota=True,user_id='2463c3d2a8b74006a1f314ec63e4c849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de36b003-e832-493e-89f9-458202eef5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de36b003-e832-493e-89f9-458202eef5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9abf286-f986-4f8d-a6ab-d9d932a7e4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9abf286-f986-4f8d-a6ab-d9d932a7e4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e89698b-eada-4dc8-8585-483e23a25218', 'volume_name': 'volume-8e89698b-eada-4dc8-8585-483e23a25218', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65233214-c9c4-4b79-a423-a8215915a542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65233214-c9c4-4b79-a423-a8215915a542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e7d851f-fc46-4b85-a4b9-2e83447b5ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:03 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Volume 8e89698b-eada-4dc8-8585-483e23a25218: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e89698b-eada-4dc8-8585-483e23a25218', 'volume_size': 1} Sep 04 15:50:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1924996578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e89698b-eada-4dc8-8585-483e23a25218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48f17c11f72e403a8d805da13bff5d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:03Z,use_quota=True,user_id='2463c3d2a8b74006a1f314ec63e4c849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:50:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Creating volume 8e89698b-eada-4dc8-8585-483e23a25218 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:50:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:50:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:50:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:50:03 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:50:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8e89698b-eada-4dc8-8585-483e23a25218 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:03 devstack sudo[90303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8e89698b-eada-4dc8-8585-483e23a25218 1073741824 Sep 04 15:50:03 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:04 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8e89698b-eada-4dc8-8585-483e23a25218 1073741824" returned: 0 in 0.634s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8e89698b-eada-4dc8-8585-483e23a25218 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:04 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8e89698b-eada-4dc8-8585-483e23a25218 Sep 04 15:50:04 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:04 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8e89698b-eada-4dc8-8585-483e23a25218" returned: 0 in 0.310s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:04 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:50:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e7d851f-fc46-4b85-a4b9-2e83447b5ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e89698b-eada-4dc8-8585-483e23a25218', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34069e34-8cd6-402a-9266-87c79d68dcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:04 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Volume volume-8e89698b-eada-4dc8-8585-483e23a25218 (8e89698b-eada-4dc8-8585-483e23a25218): created successfully Sep 04 15:50:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34069e34-8cd6-402a-9266-87c79d68dcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Flow 'volume_create_manager' (37e8c676-9af8-48c6-bc3e-3ba324283772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:04 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-862d9b69-4288-43f7-aec4-183b847fa404 tempest-ServerActionsTestOtherA-270276429 None] Created volume successfully. Sep 04 15:50:05 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:50:05 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Flow 'volume_create_manager' (6a09a8a0-7aef-41cb-89b4-4968e15f6ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:05 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d72a608-16f4-47c0-bcb4-ea3622606651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:05 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d72a608-16f4-47c0-bcb4-ea3622606651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1554000345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=764772e9-f7da-4203-a4bc-739a156c558f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcfae9cada654b99823e22a1b32d2f93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:06Z,use_quota=True,user_id='158f2d6f436342adb4b66c4190e02280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:05 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721c54ce-7544-4b35-b85b-689bb7ebbd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:05 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721c54ce-7544-4b35-b85b-689bb7ebbd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:05 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0511d3c0-8366-4b5d-863b-fa537dda60d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:05 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0511d3c0-8366-4b5d-863b-fa537dda60d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '764772e9-f7da-4203-a4bc-739a156c558f', 'volume_name': 'volume-764772e9-f7da-4203-a4bc-739a156c558f', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:05 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e991021-f36c-4536-91cf-1eb59dc9f471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:05 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e991021-f36c-4536-91cf-1eb59dc9f471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:05 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d65c08-6a13-4a4e-9563-948d531f4b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:05 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Volume 764772e9-f7da-4203-a4bc-739a156c558f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-764772e9-f7da-4203-a4bc-739a156c558f', 'volume_size': 1} Sep 04 15:50:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:05 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1554000345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=764772e9-f7da-4203-a4bc-739a156c558f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcfae9cada654b99823e22a1b32d2f93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:06Z,use_quota=True,user_id='158f2d6f436342adb4b66c4190e02280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:50:05 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Creating volume 764772e9-f7da-4203-a4bc-739a156c558f {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:50:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:05 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:50:05 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:50:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:05 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:50:05 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:50:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-764772e9-f7da-4203-a4bc-739a156c558f 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:05 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-764772e9-f7da-4203-a4bc-739a156c558f 1073741824 Sep 04 15:50:05 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:06 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-764772e9-f7da-4203-a4bc-739a156c558f 1073741824" returned: 0 in 0.607s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-764772e9-f7da-4203-a4bc-739a156c558f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:06 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-764772e9-f7da-4203-a4bc-739a156c558f Sep 04 15:50:06 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:06 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-764772e9-f7da-4203-a4bc-739a156c558f" returned: 0 in 0.406s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:06 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:50:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:06 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d65c08-6a13-4a4e-9563-948d531f4b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-764772e9-f7da-4203-a4bc-739a156c558f', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:06 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab4781f-2c62-4784-95dc-93b768476eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:06 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Volume volume-764772e9-f7da-4203-a4bc-739a156c558f (764772e9-f7da-4203-a4bc-739a156c558f): created successfully Sep 04 15:50:06 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab4781f-2c62-4784-95dc-93b768476eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:06 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Flow 'volume_create_manager' (6a09a8a0-7aef-41cb-89b4-4968e15f6ba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:06 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-7667e9c1-3d67-4a3b-83aa-3f80defe1ec0 tempest-ServersNegativeTestJSON-1440292159 None] Created volume successfully. Sep 04 15:50:09 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:50:09 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Flow 'volume_create_manager' (92c8e47c-026a-41d5-af6f-70b05e609adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:09 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f79c33b5-52a0-4a23-a5c5-297a64ff1469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:09 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f79c33b5-52a0-4a23-a5c5-297a64ff1469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-158009899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a399e5a6-e776-4ec9-8425-61c579f2036e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76030e6af3414ea8b959e4af82f601f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:09Z,use_quota=True,user_id='9f0fd8c4432c4a17966124d5a3acb02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfc88ac8-8ec7-446a-bd04-50931cb1fdf1),volume_type_id=cfc88ac8-8ec7-446a-bd04-50931cb1fdf1)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:09 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91291dea-25cf-4a0b-b991-5602e6e2d41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:09 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91291dea-25cf-4a0b-b991-5602e6e2d41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:09 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31716bb4-46c4-4787-877c-045e6d906dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:09 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31716bb4-46c4-4787-877c-045e6d906dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a399e5a6-e776-4ec9-8425-61c579f2036e', 'volume_name': 'volume-a399e5a6-e776-4ec9-8425-61c579f2036e', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:09 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87cb44b6-81a0-41d3-912c-44098bd52468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:09 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87cb44b6-81a0-41d3-912c-44098bd52468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:09 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d000c486-b6d4-4bbe-8d91-139068f01a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:09 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Volume a399e5a6-e776-4ec9-8425-61c579f2036e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a399e5a6-e776-4ec9-8425-61c579f2036e', 'volume_size': 1} Sep 04 15:50:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:09 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-158009899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a399e5a6-e776-4ec9-8425-61c579f2036e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76030e6af3414ea8b959e4af82f601f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:09Z,use_quota=True,user_id='9f0fd8c4432c4a17966124d5a3acb02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfc88ac8-8ec7-446a-bd04-50931cb1fdf1),volume_type_id=cfc88ac8-8ec7-446a-bd04-50931cb1fdf1)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:50:09 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Creating volume a399e5a6-e776-4ec9-8425-61c579f2036e {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:50:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:09 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:50:09 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:50:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:09 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:50:09 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:50:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a399e5a6-e776-4ec9-8425-61c579f2036e 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:09 devstack sudo[90328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a399e5a6-e776-4ec9-8425-61c579f2036e 1073741824 Sep 04 15:50:09 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:09 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a399e5a6-e776-4ec9-8425-61c579f2036e 1073741824" returned: 0 in 0.757s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a399e5a6-e776-4ec9-8425-61c579f2036e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:10 devstack sudo[90347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a399e5a6-e776-4ec9-8425-61c579f2036e Sep 04 15:50:10 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Flow 'volume_create_manager' (b4c26df7-9c75-47e3-99f0-edff97401fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0de8902-9b64-40bc-b099-417044ecd7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0de8902-9b64-40bc-b099-417044ecd7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-418701245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9728b454-2e3d-4b50-97a0-5e65756f7e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcfae9cada654b99823e22a1b32d2f93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:10Z,use_quota=True,user_id='158f2d6f436342adb4b66c4190e02280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4933c9f4-2a9c-416f-89a3-e079a294e199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4933c9f4-2a9c-416f-89a3-e079a294e199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b6f316-9106-4303-b63c-21f9885203d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b6f316-9106-4303-b63c-21f9885203d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9728b454-2e3d-4b50-97a0-5e65756f7e57', 'volume_name': 'volume-9728b454-2e3d-4b50-97a0-5e65756f7e57', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2382656-e573-4f01-934b-bc93589e7397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2382656-e573-4f01-934b-bc93589e7397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf58154-a2d6-4a67-9dc7-6d2aeef07748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:10 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Volume 9728b454-2e3d-4b50-97a0-5e65756f7e57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9728b454-2e3d-4b50-97a0-5e65756f7e57', 'volume_size': 1} Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:10 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a399e5a6-e776-4ec9-8425-61c579f2036e" returned: 0 in 0.326s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.126s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-418701245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9728b454-2e3d-4b50-97a0-5e65756f7e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcfae9cada654b99823e22a1b32d2f93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:10Z,use_quota=True,user_id='158f2d6f436342adb4b66c4190e02280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Creating volume 9728b454-2e3d-4b50-97a0-5e65756f7e57 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:50:10 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9728b454-2e3d-4b50-97a0-5e65756f7e57 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d000c486-b6d4-4bbe-8d91-139068f01a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a399e5a6-e776-4ec9-8425-61c579f2036e', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:10 devstack sudo[90352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9728b454-2e3d-4b50-97a0-5e65756f7e57 1073741824 Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72727fa1-0193-44dd-a893-358ec1b6c814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:10 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:10 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Volume volume-a399e5a6-e776-4ec9-8425-61c579f2036e (a399e5a6-e776-4ec9-8425-61c579f2036e): created successfully Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72727fa1-0193-44dd-a893-358ec1b6c814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Flow 'volume_create_manager' (92c8e47c-026a-41d5-af6f-70b05e609adb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:10 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-1332484f-0714-448c-85dc-46601d2cf76b tempest-VolumeTypesAccessTest-1398153570 None] Created volume successfully. Sep 04 15:50:10 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9728b454-2e3d-4b50-97a0-5e65756f7e57 1073741824" returned: 0 in 0.478s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9728b454-2e3d-4b50-97a0-5e65756f7e57 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:10 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9728b454-2e3d-4b50-97a0-5e65756f7e57 Sep 04 15:50:10 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:11 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9728b454-2e3d-4b50-97a0-5e65756f7e57" returned: 0 in 0.325s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:11 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:50:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:11 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf58154-a2d6-4a67-9dc7-6d2aeef07748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9728b454-2e3d-4b50-97a0-5e65756f7e57', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:11 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11320b48-9a6b-4193-9a9c-b1064417c2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:11 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Volume volume-9728b454-2e3d-4b50-97a0-5e65756f7e57 (9728b454-2e3d-4b50-97a0-5e65756f7e57): created successfully Sep 04 15:50:11 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11320b48-9a6b-4193-9a9c-b1064417c2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:11 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Flow 'volume_create_manager' (b4c26df7-9c75-47e3-99f0-edff97401fd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:11 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-336cdf0c-b27d-4503-aa7f-034a78e21ec4 tempest-VolumeTypesAccessTest-1398153570 None] Acquiring lock "cinder-a399e5a6-e776-4ec9-8425-61c579f2036e-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:50:11 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-d5849547-d360-44f1-b058-b4c78e5c0723 tempest-ServersNegativeTestJSON-1440292159 None] Created volume successfully. Sep 04 15:50:11 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-336cdf0c-b27d-4503-aa7f-034a78e21ec4 tempest-VolumeTypesAccessTest-1398153570 None] Lock "cinder-a399e5a6-e776-4ec9-8425-61c579f2036e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:50:11 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-336cdf0c-b27d-4503-aa7f-034a78e21ec4 tempest-VolumeTypesAccessTest-1398153570 None] Acquiring lock "cinder-quobyte-a399e5a6-e776-4ec9-8425-61c579f2036e" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:50:11 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-336cdf0c-b27d-4503-aa7f-034a78e21ec4 tempest-VolumeTypesAccessTest-1398153570 None] Lock "cinder-quobyte-a399e5a6-e776-4ec9-8425-61c579f2036e" acquired by "delete_volume" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:50:11 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee286325-22ec-4240-acf1-3fc7170a8952]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:50:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-336cdf0c-b27d-4503-aa7f-034a78e21ec4 tempest-VolumeTypesAccessTest-1398153570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a399e5a6-e776-4ec9-8425-61c579f2036e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:11 devstack sudo[90361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a399e5a6-e776-4ec9-8425-61c579f2036e Sep 04 15:50:11 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:11 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-336cdf0c-b27d-4503-aa7f-034a78e21ec4 tempest-VolumeTypesAccessTest-1398153570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a399e5a6-e776-4ec9-8425-61c579f2036e" returned: 0 in 0.421s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-336cdf0c-b27d-4503-aa7f-034a78e21ec4 tempest-VolumeTypesAccessTest-1398153570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a399e5a6-e776-4ec9-8425-61c579f2036e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:11 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a399e5a6-e776-4ec9-8425-61c579f2036e Sep 04 15:50:11 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:12 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-336cdf0c-b27d-4503-aa7f-034a78e21ec4 tempest-VolumeTypesAccessTest-1398153570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a399e5a6-e776-4ec9-8425-61c579f2036e" returned: 0 in 0.297s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-336cdf0c-b27d-4503-aa7f-034a78e21ec4 tempest-VolumeTypesAccessTest-1398153570 None] Lock "cinder-quobyte-a399e5a6-e776-4ec9-8425-61c579f2036e" released by "delete_volume" :: held 0.780s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:50:12 devstack cinder-volume[87490]: WARNING cinder.quota [None req-336cdf0c-b27d-4503-aa7f-034a78e21ec4 tempest-VolumeTypesAccessTest-1398153570 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-821006646 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-821006646, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:50:12 devstack cinder-volume[87490]: WARNING cinder.quota [None req-336cdf0c-b27d-4503-aa7f-034a78e21ec4 tempest-VolumeTypesAccessTest-1398153570 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-821006646 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-821006646, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:50:12 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-336cdf0c-b27d-4503-aa7f-034a78e21ec4 tempest-VolumeTypesAccessTest-1398153570 None] Created reservations ['86c1c96c-be01-478f-ba43-711ae695a8bb', '612bbc42-c04d-4312-8d86-c38e549c870b', 'c6d79c70-50da-473f-877f-1ba134ce5628', 'c05be7cd-be15-4eca-b0ea-c786c5f62c29'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:50:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-336cdf0c-b27d-4503-aa7f-034a78e21ec4 tempest-VolumeTypesAccessTest-1398153570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-336cdf0c-b27d-4503-aa7f-034a78e21ec4 tempest-VolumeTypesAccessTest-1398153570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-336cdf0c-b27d-4503-aa7f-034a78e21ec4 tempest-VolumeTypesAccessTest-1398153570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:50:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-336cdf0c-b27d-4503-aa7f-034a78e21ec4 tempest-VolumeTypesAccessTest-1398153570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:50:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-336cdf0c-b27d-4503-aa7f-034a78e21ec4 tempest-VolumeTypesAccessTest-1398153570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-336cdf0c-b27d-4503-aa7f-034a78e21ec4 tempest-VolumeTypesAccessTest-1398153570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:12 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:50:12 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6412fbfd-ba2e-40a4-9721-66fa7982cea4 tempest-ServersNegativeTestJSON-1440292159 None] Acquiring lock "cinder-9728b454-2e3d-4b50-97a0-5e65756f7e57-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:50:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6412fbfd-ba2e-40a4-9721-66fa7982cea4 tempest-ServersNegativeTestJSON-1440292159 None] Lock "cinder-9728b454-2e3d-4b50-97a0-5e65756f7e57-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:50:12 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6412fbfd-ba2e-40a4-9721-66fa7982cea4 tempest-ServersNegativeTestJSON-1440292159 None] Acquiring lock "cinder-quobyte-9728b454-2e3d-4b50-97a0-5e65756f7e57" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:50:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-336cdf0c-b27d-4503-aa7f-034a78e21ec4 tempest-VolumeTypesAccessTest-1398153570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.631s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:12 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-336cdf0c-b27d-4503-aa7f-034a78e21ec4 tempest-VolumeTypesAccessTest-1398153570 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:50:12 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-336cdf0c-b27d-4503-aa7f-034a78e21ec4 tempest-VolumeTypesAccessTest-1398153570 None] Deleted volume successfully. Sep 04 15:50:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6412fbfd-ba2e-40a4-9721-66fa7982cea4 tempest-ServersNegativeTestJSON-1440292159 None] Lock "cinder-quobyte-9728b454-2e3d-4b50-97a0-5e65756f7e57" acquired by "delete_volume" :: waited 0.043s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:50:13 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[b097a4a5-de1f-4fbe-a344-ae1d2966c495]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:50:13 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-336cdf0c-b27d-4503-aa7f-034a78e21ec4 tempest-VolumeTypesAccessTest-1398153570 None] Lock "cinder-a399e5a6-e776-4ec9-8425-61c579f2036e-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:50:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6412fbfd-ba2e-40a4-9721-66fa7982cea4 tempest-ServersNegativeTestJSON-1440292159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9728b454-2e3d-4b50-97a0-5e65756f7e57 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:13 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9728b454-2e3d-4b50-97a0-5e65756f7e57 Sep 04 15:50:13 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:13 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6412fbfd-ba2e-40a4-9721-66fa7982cea4 tempest-ServersNegativeTestJSON-1440292159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9728b454-2e3d-4b50-97a0-5e65756f7e57" returned: 0 in 0.653s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6412fbfd-ba2e-40a4-9721-66fa7982cea4 tempest-ServersNegativeTestJSON-1440292159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9728b454-2e3d-4b50-97a0-5e65756f7e57 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:13 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9728b454-2e3d-4b50-97a0-5e65756f7e57 Sep 04 15:50:13 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:14 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6412fbfd-ba2e-40a4-9721-66fa7982cea4 tempest-ServersNegativeTestJSON-1440292159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9728b454-2e3d-4b50-97a0-5e65756f7e57" returned: 0 in 0.374s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6412fbfd-ba2e-40a4-9721-66fa7982cea4 tempest-ServersNegativeTestJSON-1440292159 None] Lock "cinder-quobyte-9728b454-2e3d-4b50-97a0-5e65756f7e57" released by "delete_volume" :: held 1.127s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:50:14 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-6412fbfd-ba2e-40a4-9721-66fa7982cea4 tempest-ServersNegativeTestJSON-1440292159 None] Created reservations ['2b87c39a-89a8-468b-a019-ae94e9a0696b', '1af538aa-7628-4f85-a672-2c3731a64122', 'd0add912-883c-46e5-a03b-a598dda817d5', 'a1099e48-a008-4aad-b968-aee12a0c7c56'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:50:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6412fbfd-ba2e-40a4-9721-66fa7982cea4 tempest-ServersNegativeTestJSON-1440292159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6412fbfd-ba2e-40a4-9721-66fa7982cea4 tempest-ServersNegativeTestJSON-1440292159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-6412fbfd-ba2e-40a4-9721-66fa7982cea4 tempest-ServersNegativeTestJSON-1440292159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:50:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-6412fbfd-ba2e-40a4-9721-66fa7982cea4 tempest-ServersNegativeTestJSON-1440292159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:50:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6412fbfd-ba2e-40a4-9721-66fa7982cea4 tempest-ServersNegativeTestJSON-1440292159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6412fbfd-ba2e-40a4-9721-66fa7982cea4 tempest-ServersNegativeTestJSON-1440292159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:14 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:50:14 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:14 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6412fbfd-ba2e-40a4-9721-66fa7982cea4 tempest-ServersNegativeTestJSON-1440292159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.569s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:14 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-6412fbfd-ba2e-40a4-9721-66fa7982cea4 tempest-ServersNegativeTestJSON-1440292159 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:50:14 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-6412fbfd-ba2e-40a4-9721-66fa7982cea4 tempest-ServersNegativeTestJSON-1440292159 None] Deleted volume successfully. Sep 04 15:50:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6412fbfd-ba2e-40a4-9721-66fa7982cea4 tempest-ServersNegativeTestJSON-1440292159 None] Lock "cinder-9728b454-2e3d-4b50-97a0-5e65756f7e57-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:50:15 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3ba77268-5ca7-4915-9b77-0d2648eaa8d1 tempest-ServersNegativeTestJSON-1440292159 None] Acquiring lock "cinder-764772e9-f7da-4203-a4bc-739a156c558f-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:50:15 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3ba77268-5ca7-4915-9b77-0d2648eaa8d1 tempest-ServersNegativeTestJSON-1440292159 None] Lock "cinder-764772e9-f7da-4203-a4bc-739a156c558f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:50:15 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3ba77268-5ca7-4915-9b77-0d2648eaa8d1 tempest-ServersNegativeTestJSON-1440292159 None] Acquiring lock "cinder-quobyte-764772e9-f7da-4203-a4bc-739a156c558f" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:50:15 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3ba77268-5ca7-4915-9b77-0d2648eaa8d1 tempest-ServersNegativeTestJSON-1440292159 None] Lock "cinder-quobyte-764772e9-f7da-4203-a4bc-739a156c558f" acquired by "delete_volume" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:50:15 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[96da9ba7-5ad2-4efe-807f-54ebebd4bb8c]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:50:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3ba77268-5ca7-4915-9b77-0d2648eaa8d1 tempest-ServersNegativeTestJSON-1440292159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-764772e9-f7da-4203-a4bc-739a156c558f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:15 devstack sudo[90430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-764772e9-f7da-4203-a4bc-739a156c558f Sep 04 15:50:15 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:16 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3ba77268-5ca7-4915-9b77-0d2648eaa8d1 tempest-ServersNegativeTestJSON-1440292159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-764772e9-f7da-4203-a4bc-739a156c558f" returned: 0 in 0.754s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3ba77268-5ca7-4915-9b77-0d2648eaa8d1 tempest-ServersNegativeTestJSON-1440292159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-764772e9-f7da-4203-a4bc-739a156c558f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:16 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-764772e9-f7da-4203-a4bc-739a156c558f Sep 04 15:50:16 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:16 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3ba77268-5ca7-4915-9b77-0d2648eaa8d1 tempest-ServersNegativeTestJSON-1440292159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-764772e9-f7da-4203-a4bc-739a156c558f" returned: 0 in 0.403s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3ba77268-5ca7-4915-9b77-0d2648eaa8d1 tempest-ServersNegativeTestJSON-1440292159 None] Lock "cinder-quobyte-764772e9-f7da-4203-a4bc-739a156c558f" released by "delete_volume" :: held 1.240s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:50:16 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-3ba77268-5ca7-4915-9b77-0d2648eaa8d1 tempest-ServersNegativeTestJSON-1440292159 None] Created reservations ['938264f2-15ec-4661-aba9-e986cd3833cf', 'fea9ce14-6f65-4d03-8d4c-51f7f8a4fa09', '48cac2c4-0422-4d55-8da7-37553cff6d3a', '70307d17-cdba-41eb-9429-ebdf65d9b081'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:50:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3ba77268-5ca7-4915-9b77-0d2648eaa8d1 tempest-ServersNegativeTestJSON-1440292159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3ba77268-5ca7-4915-9b77-0d2648eaa8d1 tempest-ServersNegativeTestJSON-1440292159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3ba77268-5ca7-4915-9b77-0d2648eaa8d1 tempest-ServersNegativeTestJSON-1440292159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:50:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3ba77268-5ca7-4915-9b77-0d2648eaa8d1 tempest-ServersNegativeTestJSON-1440292159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:50:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3ba77268-5ca7-4915-9b77-0d2648eaa8d1 tempest-ServersNegativeTestJSON-1440292159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3ba77268-5ca7-4915-9b77-0d2648eaa8d1 tempest-ServersNegativeTestJSON-1440292159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:16 devstack sudo[90439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:50:16 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:17 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3ba77268-5ca7-4915-9b77-0d2648eaa8d1 tempest-ServersNegativeTestJSON-1440292159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.398s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:17 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-3ba77268-5ca7-4915-9b77-0d2648eaa8d1 tempest-ServersNegativeTestJSON-1440292159 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:50:17 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-3ba77268-5ca7-4915-9b77-0d2648eaa8d1 tempest-ServersNegativeTestJSON-1440292159 None] Deleted volume successfully. Sep 04 15:50:17 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3ba77268-5ca7-4915-9b77-0d2648eaa8d1 tempest-ServersNegativeTestJSON-1440292159 None] Lock "cinder-764772e9-f7da-4203-a4bc-739a156c558f-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:50:26 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=39,cinder:UPDATE=55,cinder:DELETE=3,cinder:INSERT=10 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:50:27 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:UPDATE=40,cinder:SELECT=30,cinder:INSERT=11,cinder:DELETE=5 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:38 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:50:38 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Flow 'volume_create_manager' (7c4b432a-316d-4ae2-8ecb-60071a5793ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42425618-2b7c-4c14-aafc-8502a98c2def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42425618-2b7c-4c14-aafc-8502a98c2def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1786272971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b04d4dd-42da-4e74-a0c9-6657d2b194be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c162854a87434e89122169744e795d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:38Z,use_quota=True,user_id='f32a10343d214f38b57112e4cf1969a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8f1d874-11d9-4134-93da-384c1d1ed854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8f1d874-11d9-4134-93da-384c1d1ed854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d099ba5-eb14-48e7-9131-2ee4305c8665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d099ba5-eb14-48e7-9131-2ee4305c8665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b04d4dd-42da-4e74-a0c9-6657d2b194be', 'volume_name': 'volume-8b04d4dd-42da-4e74-a0c9-6657d2b194be', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd55236-06d6-47eb-8b4f-398c74c9a190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd55236-06d6-47eb-8b4f-398c74c9a190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36dfa2aa-5e28-48ff-8a22-13e21be0e5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:38 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Volume 8b04d4dd-42da-4e74-a0c9-6657d2b194be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b04d4dd-42da-4e74-a0c9-6657d2b194be', 'volume_size': 1} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1786272971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b04d4dd-42da-4e74-a0c9-6657d2b194be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c162854a87434e89122169744e795d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:38Z,use_quota=True,user_id='f32a10343d214f38b57112e4cf1969a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Creating volume 8b04d4dd-42da-4e74-a0c9-6657d2b194be {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:50:38 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8b04d4dd-42da-4e74-a0c9-6657d2b194be 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:38 devstack sudo[90715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8b04d4dd-42da-4e74-a0c9-6657d2b194be 1073741824 Sep 04 15:50:38 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:38 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.675s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager._thread_info {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread count: 8 {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:50:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread info: [<_MainThread(MainThread, started 138899118923904)>, , , , , , , ] {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:50:39 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8b04d4dd-42da-4e74-a0c9-6657d2b194be 1073741824" returned: 0 in 0.934s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8b04d4dd-42da-4e74-a0c9-6657d2b194be {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:39 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8b04d4dd-42da-4e74-a0c9-6657d2b194be Sep 04 15:50:39 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:39 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8b04d4dd-42da-4e74-a0c9-6657d2b194be" returned: 0 in 0.284s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:50:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36dfa2aa-5e28-48ff-8a22-13e21be0e5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b04d4dd-42da-4e74-a0c9-6657d2b194be', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eecdb14e-24bd-4f15-b57c-895c3a45d58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:39 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Volume volume-8b04d4dd-42da-4e74-a0c9-6657d2b194be (8b04d4dd-42da-4e74-a0c9-6657d2b194be): created successfully Sep 04 15:50:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eecdb14e-24bd-4f15-b57c-895c3a45d58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Flow 'volume_create_manager' (7c4b432a-316d-4ae2-8ecb-60071a5793ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:39 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-178a5909-a6db-4978-88a3-ca20e071a85f tempest-VolumesListAdminTestJSON-787503088 None] Created volume successfully. Sep 04 15:50:41 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:50:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Flow 'volume_create_manager' (12707873-6f78-436e-8511-19a3b2a808bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92db14c7-443a-4e28-b409-2253b23293ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92db14c7-443a-4e28-b409-2253b23293ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-448325045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe4c537-67ba-4ba7-a078-d7bf384d3801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c162854a87434e89122169744e795d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:41Z,use_quota=True,user_id='f32a10343d214f38b57112e4cf1969a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526ec719-6c66-4ac2-a936-2b0159534c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526ec719-6c66-4ac2-a936-2b0159534c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ea0d7c9-aad3-40d5-a0f0-4f80b5f1977d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ea0d7c9-aad3-40d5-a0f0-4f80b5f1977d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffe4c537-67ba-4ba7-a078-d7bf384d3801', 'volume_name': 'volume-ffe4c537-67ba-4ba7-a078-d7bf384d3801', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403a58f1-2733-4350-a71e-0f8d9c9d35e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403a58f1-2733-4350-a71e-0f8d9c9d35e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c163098e-ed53-444f-bdba-d233d1f815bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:41 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Volume ffe4c537-67ba-4ba7-a078-d7bf384d3801: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffe4c537-67ba-4ba7-a078-d7bf384d3801', 'volume_size': 1} Sep 04 15:50:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:41 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-448325045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe4c537-67ba-4ba7-a078-d7bf384d3801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c162854a87434e89122169744e795d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:41Z,use_quota=True,user_id='f32a10343d214f38b57112e4cf1969a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:50:41 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Creating volume ffe4c537-67ba-4ba7-a078-d7bf384d3801 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:50:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:41 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:50:41 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:50:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:41 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:50:41 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:50:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ffe4c537-67ba-4ba7-a078-d7bf384d3801 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:41 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ffe4c537-67ba-4ba7-a078-d7bf384d3801 1073741824 Sep 04 15:50:41 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-358231b7-5c75-4f69-b0ec-28554b383da7 req-7771b1ff-c91c-4855-b0d7-1aad1f4901b5 tempest-ServerActionsTestOtherA-270276429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:42 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ffe4c537-67ba-4ba7-a078-d7bf384d3801 1073741824" returned: 0 in 0.708s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ffe4c537-67ba-4ba7-a078-d7bf384d3801 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:42 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ffe4c537-67ba-4ba7-a078-d7bf384d3801 Sep 04 15:50:42 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:42 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ffe4c537-67ba-4ba7-a078-d7bf384d3801" returned: 0 in 0.473s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:42 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:50:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-358231b7-5c75-4f69-b0ec-28554b383da7 req-7771b1ff-c91c-4855-b0d7-1aad1f4901b5 tempest-ServerActionsTestOtherA-270276429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.042s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-358231b7-5c75-4f69-b0ec-28554b383da7 req-7771b1ff-c91c-4855-b0d7-1aad1f4901b5 tempest-ServerActionsTestOtherA-270276429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c163098e-ed53-444f-bdba-d233d1f815bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffe4c537-67ba-4ba7-a078-d7bf384d3801', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b29df0-208a-4c38-a661-ec7076b8e541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:42 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Volume volume-ffe4c537-67ba-4ba7-a078-d7bf384d3801 (ffe4c537-67ba-4ba7-a078-d7bf384d3801): created successfully Sep 04 15:50:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b29df0-208a-4c38-a661-ec7076b8e541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Flow 'volume_create_manager' (12707873-6f78-436e-8511-19a3b2a808bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:42 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-f8e888a2-2dda-4e41-831c-ce4fc170b7e9 tempest-VolumesListAdminTestJSON-787503088 None] Created volume successfully. Sep 04 15:50:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-358231b7-5c75-4f69-b0ec-28554b383da7 req-7771b1ff-c91c-4855-b0d7-1aad1f4901b5 tempest-ServerActionsTestOtherA-270276429 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787', 'name': 'volume-8e89698b-eada-4dc8-8585-483e23a25218', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b40b47d-60ec-48c2-9d8d-b165a34c3af8', 'enforce_multipath': True} {{(pid=87490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:50:42 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-358231b7-5c75-4f69-b0ec-28554b383da7 req-7771b1ff-c91c-4855-b0d7-1aad1f4901b5 tempest-ServerActionsTestOtherA-270276429 None] attachment_update completed successfully. Sep 04 15:50:45 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:50:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Flow 'volume_create_manager' (495f15da-1cb7-4620-8a58-1374ff1ac003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (603561a8-581d-44f5-a28e-dab6575d2840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (603561a8-581d-44f5-a28e-dab6575d2840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2067616707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99ebbf06-7481-405b-b6a9-50879428f997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c162854a87434e89122169744e795d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:45Z,use_quota=True,user_id='f32a10343d214f38b57112e4cf1969a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (309ab883-9d52-4909-8e08-87951eaa1148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (309ab883-9d52-4909-8e08-87951eaa1148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a2bf0e1-fa34-49e9-9104-699d6881069c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a2bf0e1-fa34-49e9-9104-699d6881069c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99ebbf06-7481-405b-b6a9-50879428f997', 'volume_name': 'volume-99ebbf06-7481-405b-b6a9-50879428f997', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0a8e6f-5a9c-4aaa-8fda-61d87f55d1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0a8e6f-5a9c-4aaa-8fda-61d87f55d1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ca4d2d-aa3d-41a3-b6fd-35a79734e602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:45 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Volume 99ebbf06-7481-405b-b6a9-50879428f997: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99ebbf06-7481-405b-b6a9-50879428f997', 'volume_size': 1} Sep 04 15:50:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2067616707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99ebbf06-7481-405b-b6a9-50879428f997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c162854a87434e89122169744e795d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:45Z,use_quota=True,user_id='f32a10343d214f38b57112e4cf1969a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:50:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Creating volume 99ebbf06-7481-405b-b6a9-50879428f997 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:50:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:50:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:50:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:50:45 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:50:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-99ebbf06-7481-405b-b6a9-50879428f997 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:45 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-99ebbf06-7481-405b-b6a9-50879428f997 1073741824 Sep 04 15:50:45 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:46 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:50:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Flow 'volume_create_manager' (665c19bd-8b8a-4170-98dc-6dce44fe4a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca01043-3261-4c4c-8ed0-c3674ced578b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca01043-3261-4c4c-8ed0-c3674ced578b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-587541462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f6970de-327d-4af3-b519-470a9aa939c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d64a23af7448acbe3676d4bd355bc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:46Z,use_quota=True,user_id='69b62f4a9f884e92b60123ede49e66c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b9eccc-7747-43d6-94f8-5cba55a1d789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b9eccc-7747-43d6-94f8-5cba55a1d789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab3d40c-7b38-437b-ab98-83e9e96d8fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab3d40c-7b38-437b-ab98-83e9e96d8fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f6970de-327d-4af3-b519-470a9aa939c1', 'volume_name': 'volume-4f6970de-327d-4af3-b519-470a9aa939c1', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d990676-f7bc-4eba-b5d9-169ecb4a4584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d990676-f7bc-4eba-b5d9-169ecb4a4584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (566c1648-b37f-416d-aa15-7ef109cb32bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:46 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Volume 4f6970de-327d-4af3-b519-470a9aa939c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f6970de-327d-4af3-b519-470a9aa939c1', 'volume_size': 1} Sep 04 15:50:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:46 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-99ebbf06-7481-405b-b6a9-50879428f997 1073741824" returned: 0 in 0.973s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-99ebbf06-7481-405b-b6a9-50879428f997 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:46 devstack sudo[91187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-99ebbf06-7481-405b-b6a9-50879428f997 Sep 04 15:50:46 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:47 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-99ebbf06-7481-405b-b6a9-50879428f997" returned: 0 in 0.777s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:47 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] <== create_volume: return (1886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:50:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.138s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:47 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-587541462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f6970de-327d-4af3-b519-470a9aa939c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d64a23af7448acbe3676d4bd355bc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:46Z,use_quota=True,user_id='69b62f4a9f884e92b60123ede49e66c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:50:47 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Creating volume 4f6970de-327d-4af3-b519-470a9aa939c1 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:50:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:47 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:50:47 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:50:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:47 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:50:47 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:50:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f6970de-327d-4af3-b519-470a9aa939c1 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:47 devstack sudo[91194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f6970de-327d-4af3-b519-470a9aa939c1 1073741824 Sep 04 15:50:47 devstack sudo[91194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ca4d2d-aa3d-41a3-b6fd-35a79734e602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99ebbf06-7481-405b-b6a9-50879428f997', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ec068c-dd53-44b9-9b50-a51e07793dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:47 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Volume volume-99ebbf06-7481-405b-b6a9-50879428f997 (99ebbf06-7481-405b-b6a9-50879428f997): created successfully Sep 04 15:50:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ec068c-dd53-44b9-9b50-a51e07793dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Flow 'volume_create_manager' (495f15da-1cb7-4620-8a58-1374ff1ac003) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:47 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-c38a9408-79c1-4bf5-914d-239b66a26032 tempest-VolumesListAdminTestJSON-787503088 None] Created volume successfully. Sep 04 15:50:48 devstack sudo[91194]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f6970de-327d-4af3-b519-470a9aa939c1 1073741824" returned: 0 in 0.822s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f6970de-327d-4af3-b519-470a9aa939c1 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:48 devstack sudo[91205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f6970de-327d-4af3-b519-470a9aa939c1 Sep 04 15:50:48 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:49 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f6970de-327d-4af3-b519-470a9aa939c1" returned: 0 in 0.726s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:50:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (566c1648-b37f-416d-aa15-7ef109cb32bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f6970de-327d-4af3-b519-470a9aa939c1', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81e7b90-d8ad-4b89-87f9-3718d9c7e72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:49 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Volume volume-4f6970de-327d-4af3-b519-470a9aa939c1 (4f6970de-327d-4af3-b519-470a9aa939c1): created successfully Sep 04 15:50:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81e7b90-d8ad-4b89-87f9-3718d9c7e72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Flow 'volume_create_manager' (665c19bd-8b8a-4170-98dc-6dce44fe4a30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:49 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-9224e228-b321-4a74-9003-6af91aee319e tempest-ServerRescueNegativeTestJSON-802918399 None] Created volume successfully. Sep 04 15:50:49 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-e4aef7e1-fa6b-4203-ae7f-0902b6cff6be req-ddded948-0a51-4224-b100-2ae9c618e25c tempest-ServerActionsTestOtherA-270276429 None] Terminate volume connection completed successfully. Sep 04 15:50:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-e4aef7e1-fa6b-4203-ae7f-0902b6cff6be req-ddded948-0a51-4224-b100-2ae9c618e25c tempest-ServerActionsTestOtherA-270276429 None] Deleting attachment 5b40b47d-60ec-48c2-9d8d-b165a34c3af8. {{(pid=87490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:50:51 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:50:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Flow 'volume_create_manager' (e065d410-74c2-4b80-b82d-1e8067706467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c277ff7a-2ef3-45d9-8ef5-2bdaeb8cea30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c277ff7a-2ef3-45d9-8ef5-2bdaeb8cea30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c395988e-79d6-4623-81ed-dce8a0791ea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3702382223164dff8bc06855c84e11f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:51Z,use_quota=True,user_id='65f9445aeed248188db046a3d44bcb76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371b02c7-c75d-401b-ae33-471911c76b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371b02c7-c75d-401b-ae33-471911c76b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f029f0e-20aa-4829-ab9e-c0418cf99e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f029f0e-20aa-4829-ab9e-c0418cf99e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c395988e-79d6-4623-81ed-dce8a0791ea8', 'volume_name': 'volume-c395988e-79d6-4623-81ed-dce8a0791ea8', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a05d69df-c5f2-4354-969c-4bf028e1c83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a05d69df-c5f2-4354-969c-4bf028e1c83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d19c633-e955-4f68-862c-547fde65e689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:51 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Volume c395988e-79d6-4623-81ed-dce8a0791ea8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c395988e-79d6-4623-81ed-dce8a0791ea8', 'volume_size': 1} Sep 04 15:50:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:51 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c395988e-79d6-4623-81ed-dce8a0791ea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3702382223164dff8bc06855c84e11f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:50:51Z,use_quota=True,user_id='65f9445aeed248188db046a3d44bcb76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:50:51 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Creating volume c395988e-79d6-4623-81ed-dce8a0791ea8 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:50:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:51 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:50:51 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:50:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:51 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:50:51 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:50:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c395988e-79d6-4623-81ed-dce8a0791ea8 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:51 devstack sudo[91290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c395988e-79d6-4623-81ed-dce8a0791ea8 1073741824 Sep 04 15:50:51 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-e4aef7e1-fa6b-4203-ae7f-0902b6cff6be req-aa3026a9-0902-4e23-9b1c-f6baa5e08b97 tempest-ServerActionsTestOtherA-270276429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:52 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c395988e-79d6-4623-81ed-dce8a0791ea8 1073741824" returned: 0 in 0.634s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c395988e-79d6-4623-81ed-dce8a0791ea8 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:52 devstack sudo[91297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c395988e-79d6-4623-81ed-dce8a0791ea8 Sep 04 15:50:52 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:52 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c395988e-79d6-4623-81ed-dce8a0791ea8" returned: 0 in 0.347s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:52 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:50:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-e4aef7e1-fa6b-4203-ae7f-0902b6cff6be req-aa3026a9-0902-4e23-9b1c-f6baa5e08b97 tempest-ServerActionsTestOtherA-270276429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.666s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-e4aef7e1-fa6b-4203-ae7f-0902b6cff6be req-aa3026a9-0902-4e23-9b1c-f6baa5e08b97 tempest-ServerActionsTestOtherA-270276429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:52 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d19c633-e955-4f68-862c-547fde65e689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c395988e-79d6-4623-81ed-dce8a0791ea8', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:52 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b24b255f-0284-4c10-8689-4c84dc258ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:50:52 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Volume volume-c395988e-79d6-4623-81ed-dce8a0791ea8 (c395988e-79d6-4623-81ed-dce8a0791ea8): created successfully Sep 04 15:50:52 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b24b255f-0284-4c10-8689-4c84dc258ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:50:52 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Flow 'volume_create_manager' (e065d410-74c2-4b80-b82d-1e8067706467) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:50:52 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-26e1ade4-c4aa-4177-99b3-26115a10010c tempest-VolumesListAdminTestJSON-1475488365 None] Created volume successfully. Sep 04 15:50:52 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-e4aef7e1-fa6b-4203-ae7f-0902b6cff6be req-aa3026a9-0902-4e23-9b1c-f6baa5e08b97 tempest-ServerActionsTestOtherA-270276429 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787', 'name': 'volume-8e89698b-eada-4dc8-8585-483e23a25218', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d1371d7-5ffb-4f69-b518-7bc7256eb239', 'enforce_multipath': True} {{(pid=87490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:50:52 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-e4aef7e1-fa6b-4203-ae7f-0902b6cff6be req-aa3026a9-0902-4e23-9b1c-f6baa5e08b97 tempest-ServerActionsTestOtherA-270276429 None] attachment_update completed successfully. Sep 04 15:50:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ee956a88-3c61-42c6-98c1-448aa4609b88 tempest-VolumesListAdminTestJSON-1475488365 None] Acquiring lock "cinder-c395988e-79d6-4623-81ed-dce8a0791ea8-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:50:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ee956a88-3c61-42c6-98c1-448aa4609b88 tempest-VolumesListAdminTestJSON-1475488365 None] Lock "cinder-c395988e-79d6-4623-81ed-dce8a0791ea8-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:50:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ee956a88-3c61-42c6-98c1-448aa4609b88 tempest-VolumesListAdminTestJSON-1475488365 None] Acquiring lock "cinder-quobyte-c395988e-79d6-4623-81ed-dce8a0791ea8" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:50:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ee956a88-3c61-42c6-98c1-448aa4609b88 tempest-VolumesListAdminTestJSON-1475488365 None] Lock "cinder-quobyte-c395988e-79d6-4623-81ed-dce8a0791ea8" acquired by "delete_volume" :: waited 0.040s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:50:53 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[f340aa30-24db-4ea9-9e02-adbd6f53adc8]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:50:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ee956a88-3c61-42c6-98c1-448aa4609b88 tempest-VolumesListAdminTestJSON-1475488365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c395988e-79d6-4623-81ed-dce8a0791ea8 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d8a627c3-4f52-46e9-acb3-65a3c88d108a tempest-VolumesListAdminTestJSON-787503088 None] Acquiring lock "cinder-99ebbf06-7481-405b-b6a9-50879428f997-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:50:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d8a627c3-4f52-46e9-acb3-65a3c88d108a tempest-VolumesListAdminTestJSON-787503088 None] Lock "cinder-99ebbf06-7481-405b-b6a9-50879428f997-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:50:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d8a627c3-4f52-46e9-acb3-65a3c88d108a tempest-VolumesListAdminTestJSON-787503088 None] Acquiring lock "cinder-quobyte-99ebbf06-7481-405b-b6a9-50879428f997" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:50:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d8a627c3-4f52-46e9-acb3-65a3c88d108a tempest-VolumesListAdminTestJSON-787503088 None] Lock "cinder-quobyte-99ebbf06-7481-405b-b6a9-50879428f997" acquired by "delete_volume" :: waited 0.032s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:50:54 devstack sudo[91314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c395988e-79d6-4623-81ed-dce8a0791ea8 Sep 04 15:50:54 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:54 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2a3cea-8b8c-4831-869a-682a8f4ce73c]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:50:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d8a627c3-4f52-46e9-acb3-65a3c88d108a tempest-VolumesListAdminTestJSON-787503088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-99ebbf06-7481-405b-b6a9-50879428f997 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:54 devstack sudo[91318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-99ebbf06-7481-405b-b6a9-50879428f997 Sep 04 15:50:54 devstack sudo[91318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:54 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ee956a88-3c61-42c6-98c1-448aa4609b88 tempest-VolumesListAdminTestJSON-1475488365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c395988e-79d6-4623-81ed-dce8a0791ea8" returned: 0 in 0.835s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ee956a88-3c61-42c6-98c1-448aa4609b88 tempest-VolumesListAdminTestJSON-1475488365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c395988e-79d6-4623-81ed-dce8a0791ea8 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:54 devstack sudo[91326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c395988e-79d6-4623-81ed-dce8a0791ea8 Sep 04 15:50:54 devstack sudo[91326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:55 devstack sudo[91318]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d8a627c3-4f52-46e9-acb3-65a3c88d108a tempest-VolumesListAdminTestJSON-787503088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-99ebbf06-7481-405b-b6a9-50879428f997" returned: 0 in 1.182s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d8a627c3-4f52-46e9-acb3-65a3c88d108a tempest-VolumesListAdminTestJSON-787503088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-99ebbf06-7481-405b-b6a9-50879428f997 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:55 devstack sudo[91326]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ee956a88-3c61-42c6-98c1-448aa4609b88 tempest-VolumesListAdminTestJSON-1475488365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c395988e-79d6-4623-81ed-dce8a0791ea8" returned: 0 in 0.609s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ee956a88-3c61-42c6-98c1-448aa4609b88 tempest-VolumesListAdminTestJSON-1475488365 None] Lock "cinder-quobyte-c395988e-79d6-4623-81ed-dce8a0791ea8" released by "delete_volume" :: held 1.543s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:50:55 devstack sudo[91405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-99ebbf06-7481-405b-b6a9-50879428f997 Sep 04 15:50:55 devstack sudo[91405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:55 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-ee956a88-3c61-42c6-98c1-448aa4609b88 tempest-VolumesListAdminTestJSON-1475488365 None] Created reservations ['fe9d5663-9f73-47a4-b990-740c91889252', '954fa7c1-fd05-4dfb-aa59-e19e2c2f84fd', 'ccbc71f5-4b60-4bce-9eef-1da105fd5802', 'cb2dbd16-d74d-4447-ba3e-468c293ac52c'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:50:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ee956a88-3c61-42c6-98c1-448aa4609b88 tempest-VolumesListAdminTestJSON-1475488365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ee956a88-3c61-42c6-98c1-448aa4609b88 tempest-VolumesListAdminTestJSON-1475488365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:55 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ee956a88-3c61-42c6-98c1-448aa4609b88 tempest-VolumesListAdminTestJSON-1475488365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:50:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ee956a88-3c61-42c6-98c1-448aa4609b88 tempest-VolumesListAdminTestJSON-1475488365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:50:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ee956a88-3c61-42c6-98c1-448aa4609b88 tempest-VolumesListAdminTestJSON-1475488365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ee956a88-3c61-42c6-98c1-448aa4609b88 tempest-VolumesListAdminTestJSON-1475488365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:56 devstack sudo[91431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:50:56 devstack sudo[91431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:56 devstack sudo[91405]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d8a627c3-4f52-46e9-acb3-65a3c88d108a tempest-VolumesListAdminTestJSON-787503088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-99ebbf06-7481-405b-b6a9-50879428f997" returned: 0 in 0.828s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d8a627c3-4f52-46e9-acb3-65a3c88d108a tempest-VolumesListAdminTestJSON-787503088 None] Lock "cinder-quobyte-99ebbf06-7481-405b-b6a9-50879428f997" released by "delete_volume" :: held 2.119s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:50:56 devstack sudo[91431]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ee956a88-3c61-42c6-98c1-448aa4609b88 tempest-VolumesListAdminTestJSON-1475488365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.399s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:56 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-ee956a88-3c61-42c6-98c1-448aa4609b88 tempest-VolumesListAdminTestJSON-1475488365 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:50:56 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-ee956a88-3c61-42c6-98c1-448aa4609b88 tempest-VolumesListAdminTestJSON-1475488365 None] Deleted volume successfully. Sep 04 15:50:56 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-d8a627c3-4f52-46e9-acb3-65a3c88d108a tempest-VolumesListAdminTestJSON-787503088 None] Created reservations ['2b584184-b206-402f-ac2f-b663fd8d21ff', '3992de5f-f8d0-4dd5-90ce-b0e3249439a0', 'd8143494-0ab6-433d-ba02-28dfa28f7a18', '5a423bfd-6046-454e-acc0-407df1987e1a'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:50:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ee956a88-3c61-42c6-98c1-448aa4609b88 tempest-VolumesListAdminTestJSON-1475488365 None] Lock "cinder-c395988e-79d6-4623-81ed-dce8a0791ea8-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:50:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d8a627c3-4f52-46e9-acb3-65a3c88d108a tempest-VolumesListAdminTestJSON-787503088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:50:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d8a627c3-4f52-46e9-acb3-65a3c88d108a tempest-VolumesListAdminTestJSON-787503088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:50:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d8a627c3-4f52-46e9-acb3-65a3c88d108a tempest-VolumesListAdminTestJSON-787503088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:50:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d8a627c3-4f52-46e9-acb3-65a3c88d108a tempest-VolumesListAdminTestJSON-787503088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:50:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d8a627c3-4f52-46e9-acb3-65a3c88d108a tempest-VolumesListAdminTestJSON-787503088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:50:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d8a627c3-4f52-46e9-acb3-65a3c88d108a tempest-VolumesListAdminTestJSON-787503088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:56 devstack sudo[91763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:50:56 devstack sudo[91763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:57 devstack sudo[91763]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d8a627c3-4f52-46e9-acb3-65a3c88d108a tempest-VolumesListAdminTestJSON-787503088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.588s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:57 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d8a627c3-4f52-46e9-acb3-65a3c88d108a tempest-VolumesListAdminTestJSON-787503088 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:50:57 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-d8a627c3-4f52-46e9-acb3-65a3c88d108a tempest-VolumesListAdminTestJSON-787503088 None] Deleted volume successfully. Sep 04 15:50:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d8a627c3-4f52-46e9-acb3-65a3c88d108a tempest-VolumesListAdminTestJSON-787503088 None] Lock "cinder-99ebbf06-7481-405b-b6a9-50879428f997-delete_volume" released by "delete_volume" :: held 3.343s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:50:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d8149733-9fd6-43fa-ba95-87490013d218 tempest-VolumesListAdminTestJSON-787503088 None] Acquiring lock "cinder-ffe4c537-67ba-4ba7-a078-d7bf384d3801-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:50:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d8149733-9fd6-43fa-ba95-87490013d218 tempest-VolumesListAdminTestJSON-787503088 None] Lock "cinder-ffe4c537-67ba-4ba7-a078-d7bf384d3801-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:50:58 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d8149733-9fd6-43fa-ba95-87490013d218 tempest-VolumesListAdminTestJSON-787503088 None] Acquiring lock "cinder-quobyte-ffe4c537-67ba-4ba7-a078-d7bf384d3801" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:50:58 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d8149733-9fd6-43fa-ba95-87490013d218 tempest-VolumesListAdminTestJSON-787503088 None] Lock "cinder-quobyte-ffe4c537-67ba-4ba7-a078-d7bf384d3801" acquired by "delete_volume" :: waited 0.043s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:50:58 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[3414f41a-7b08-4bac-90ae-b5a1e7fbc723]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:50:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d8149733-9fd6-43fa-ba95-87490013d218 tempest-VolumesListAdminTestJSON-787503088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ffe4c537-67ba-4ba7-a078-d7bf384d3801 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:58 devstack sudo[91807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ffe4c537-67ba-4ba7-a078-d7bf384d3801 Sep 04 15:50:58 devstack sudo[91807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:59 devstack sudo[91807]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d8149733-9fd6-43fa-ba95-87490013d218 tempest-VolumesListAdminTestJSON-787503088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ffe4c537-67ba-4ba7-a078-d7bf384d3801" returned: 0 in 1.088s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d8149733-9fd6-43fa-ba95-87490013d218 tempest-VolumesListAdminTestJSON-787503088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ffe4c537-67ba-4ba7-a078-d7bf384d3801 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:50:59 devstack sudo[91840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ffe4c537-67ba-4ba7-a078-d7bf384d3801 Sep 04 15:50:59 devstack sudo[91840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:50:59 devstack sudo[91840]: pam_unix(sudo:session): session closed for user root Sep 04 15:50:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d8149733-9fd6-43fa-ba95-87490013d218 tempest-VolumesListAdminTestJSON-787503088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ffe4c537-67ba-4ba7-a078-d7bf384d3801" returned: 0 in 0.627s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:50:59 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d8149733-9fd6-43fa-ba95-87490013d218 tempest-VolumesListAdminTestJSON-787503088 None] Lock "cinder-quobyte-ffe4c537-67ba-4ba7-a078-d7bf384d3801" released by "delete_volume" :: held 1.808s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:50:59 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-d8149733-9fd6-43fa-ba95-87490013d218 tempest-VolumesListAdminTestJSON-787503088 None] Created reservations ['a0d43b3d-222d-4699-9fdd-e9a02d89ae3e', 'ce74af3a-3b3d-4193-a297-9749131c0d35', 'ff8493a1-5aff-4256-be46-114b3293778e', 'a6efc9e3-bcbe-450e-9d5e-00b853ddf0fa'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:51:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d8149733-9fd6-43fa-ba95-87490013d218 tempest-VolumesListAdminTestJSON-787503088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d8149733-9fd6-43fa-ba95-87490013d218 tempest-VolumesListAdminTestJSON-787503088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:00 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d8149733-9fd6-43fa-ba95-87490013d218 tempest-VolumesListAdminTestJSON-787503088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:51:00 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d8149733-9fd6-43fa-ba95-87490013d218 tempest-VolumesListAdminTestJSON-787503088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:51:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d8149733-9fd6-43fa-ba95-87490013d218 tempest-VolumesListAdminTestJSON-787503088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d8149733-9fd6-43fa-ba95-87490013d218 tempest-VolumesListAdminTestJSON-787503088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:00 devstack sudo[91846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:51:00 devstack sudo[91846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:00 devstack sudo[91846]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d8149733-9fd6-43fa-ba95-87490013d218 tempest-VolumesListAdminTestJSON-787503088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.473s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:00 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d8149733-9fd6-43fa-ba95-87490013d218 tempest-VolumesListAdminTestJSON-787503088 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:51:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6d1d1ad8-09ff-4e72-98da-4875fed0d0ac tempest-VolumesListAdminTestJSON-787503088 None] Acquiring lock "cinder-8b04d4dd-42da-4e74-a0c9-6657d2b194be-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:00 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-d8149733-9fd6-43fa-ba95-87490013d218 tempest-VolumesListAdminTestJSON-787503088 None] Deleted volume successfully. Sep 04 15:51:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d8149733-9fd6-43fa-ba95-87490013d218 tempest-VolumesListAdminTestJSON-787503088 None] Lock "cinder-ffe4c537-67ba-4ba7-a078-d7bf384d3801-delete_volume" released by "delete_volume" :: held 2.762s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6d1d1ad8-09ff-4e72-98da-4875fed0d0ac tempest-VolumesListAdminTestJSON-787503088 None] Lock "cinder-8b04d4dd-42da-4e74-a0c9-6657d2b194be-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6d1d1ad8-09ff-4e72-98da-4875fed0d0ac tempest-VolumesListAdminTestJSON-787503088 None] Acquiring lock "cinder-quobyte-8b04d4dd-42da-4e74-a0c9-6657d2b194be" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6d1d1ad8-09ff-4e72-98da-4875fed0d0ac tempest-VolumesListAdminTestJSON-787503088 None] Lock "cinder-quobyte-8b04d4dd-42da-4e74-a0c9-6657d2b194be" acquired by "delete_volume" :: waited 0.034s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:00 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe23b25-29de-4634-bc24-099dfe4802b2]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6d1d1ad8-09ff-4e72-98da-4875fed0d0ac tempest-VolumesListAdminTestJSON-787503088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8b04d4dd-42da-4e74-a0c9-6657d2b194be {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:01 devstack sudo[91850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8b04d4dd-42da-4e74-a0c9-6657d2b194be Sep 04 15:51:01 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:01 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6d1d1ad8-09ff-4e72-98da-4875fed0d0ac tempest-VolumesListAdminTestJSON-787503088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8b04d4dd-42da-4e74-a0c9-6657d2b194be" returned: 0 in 0.669s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6d1d1ad8-09ff-4e72-98da-4875fed0d0ac tempest-VolumesListAdminTestJSON-787503088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8b04d4dd-42da-4e74-a0c9-6657d2b194be {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:01 devstack sudo[91856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8b04d4dd-42da-4e74-a0c9-6657d2b194be Sep 04 15:51:01 devstack sudo[91856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:02 devstack sudo[91856]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6d1d1ad8-09ff-4e72-98da-4875fed0d0ac tempest-VolumesListAdminTestJSON-787503088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8b04d4dd-42da-4e74-a0c9-6657d2b194be" returned: 0 in 0.494s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:02 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6d1d1ad8-09ff-4e72-98da-4875fed0d0ac tempest-VolumesListAdminTestJSON-787503088 None] Lock "cinder-quobyte-8b04d4dd-42da-4e74-a0c9-6657d2b194be" released by "delete_volume" :: held 1.262s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:02 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-6d1d1ad8-09ff-4e72-98da-4875fed0d0ac tempest-VolumesListAdminTestJSON-787503088 None] Created reservations ['1951fbe5-2e6d-4b3a-b0fe-cd821c39e1db', '3cd11682-2445-439e-83b2-bb9dba20e1dd', '756aa7d6-a24f-4cf9-84a2-ff11246fa8e0', 'e03695f6-fcc7-479a-9f54-dec98d14ad53'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:51:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6d1d1ad8-09ff-4e72-98da-4875fed0d0ac tempest-VolumesListAdminTestJSON-787503088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6d1d1ad8-09ff-4e72-98da-4875fed0d0ac tempest-VolumesListAdminTestJSON-787503088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:02 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-6d1d1ad8-09ff-4e72-98da-4875fed0d0ac tempest-VolumesListAdminTestJSON-787503088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:51:02 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-6d1d1ad8-09ff-4e72-98da-4875fed0d0ac tempest-VolumesListAdminTestJSON-787503088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:51:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6d1d1ad8-09ff-4e72-98da-4875fed0d0ac tempest-VolumesListAdminTestJSON-787503088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6d1d1ad8-09ff-4e72-98da-4875fed0d0ac tempest-VolumesListAdminTestJSON-787503088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:02 devstack sudo[91859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:51:02 devstack sudo[91859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:02 devstack sudo[91859]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6d1d1ad8-09ff-4e72-98da-4875fed0d0ac tempest-VolumesListAdminTestJSON-787503088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.332s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:02 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-6d1d1ad8-09ff-4e72-98da-4875fed0d0ac tempest-VolumesListAdminTestJSON-787503088 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:51:02 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-6d1d1ad8-09ff-4e72-98da-4875fed0d0ac tempest-VolumesListAdminTestJSON-787503088 None] Deleted volume successfully. Sep 04 15:51:02 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6d1d1ad8-09ff-4e72-98da-4875fed0d0ac tempest-VolumesListAdminTestJSON-787503088 None] Lock "cinder-8b04d4dd-42da-4e74-a0c9-6657d2b194be-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e5360829-0def-480a-856a-d2375f56fe28 tempest-ServerRescueNegativeTestJSON-802918399 None] Acquiring lock "cinder-4f6970de-327d-4af3-b519-470a9aa939c1-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e5360829-0def-480a-856a-d2375f56fe28 tempest-ServerRescueNegativeTestJSON-802918399 None] Lock "cinder-4f6970de-327d-4af3-b519-470a9aa939c1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e5360829-0def-480a-856a-d2375f56fe28 tempest-ServerRescueNegativeTestJSON-802918399 None] Acquiring lock "cinder-quobyte-4f6970de-327d-4af3-b519-470a9aa939c1" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e5360829-0def-480a-856a-d2375f56fe28 tempest-ServerRescueNegativeTestJSON-802918399 None] Lock "cinder-quobyte-4f6970de-327d-4af3-b519-470a9aa939c1" acquired by "delete_volume" :: waited 0.025s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:06 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8d13a7-fd4b-40de-8024-7d9c876b0a0a]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e5360829-0def-480a-856a-d2375f56fe28 tempest-ServerRescueNegativeTestJSON-802918399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f6970de-327d-4af3-b519-470a9aa939c1 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:07 devstack sudo[91898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f6970de-327d-4af3-b519-470a9aa939c1 Sep 04 15:51:07 devstack sudo[91898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:07 devstack sudo[91898]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e5360829-0def-480a-856a-d2375f56fe28 tempest-ServerRescueNegativeTestJSON-802918399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f6970de-327d-4af3-b519-470a9aa939c1" returned: 0 in 1.101s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e5360829-0def-480a-856a-d2375f56fe28 tempest-ServerRescueNegativeTestJSON-802918399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f6970de-327d-4af3-b519-470a9aa939c1 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:07 devstack sudo[91904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f6970de-327d-4af3-b519-470a9aa939c1 Sep 04 15:51:07 devstack sudo[91904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:08 devstack sudo[91904]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e5360829-0def-480a-856a-d2375f56fe28 tempest-ServerRescueNegativeTestJSON-802918399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f6970de-327d-4af3-b519-470a9aa939c1" returned: 0 in 0.413s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:08 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e5360829-0def-480a-856a-d2375f56fe28 tempest-ServerRescueNegativeTestJSON-802918399 None] Lock "cinder-quobyte-4f6970de-327d-4af3-b519-470a9aa939c1" released by "delete_volume" :: held 1.611s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:08 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-e5360829-0def-480a-856a-d2375f56fe28 tempest-ServerRescueNegativeTestJSON-802918399 None] Created reservations ['0f347a7d-a5fa-4e27-8d63-689a5c55edbe', 'b734496b-5822-409e-9143-abe2b1742350', '502a89a3-f6da-4190-b951-ed9d5c7b2a08', '397aaa08-3037-49a1-a8b9-2ef678bf422d'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:51:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e5360829-0def-480a-856a-d2375f56fe28 tempest-ServerRescueNegativeTestJSON-802918399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e5360829-0def-480a-856a-d2375f56fe28 tempest-ServerRescueNegativeTestJSON-802918399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:08 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e5360829-0def-480a-856a-d2375f56fe28 tempest-ServerRescueNegativeTestJSON-802918399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:51:08 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e5360829-0def-480a-856a-d2375f56fe28 tempest-ServerRescueNegativeTestJSON-802918399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:51:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e5360829-0def-480a-856a-d2375f56fe28 tempest-ServerRescueNegativeTestJSON-802918399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e5360829-0def-480a-856a-d2375f56fe28 tempest-ServerRescueNegativeTestJSON-802918399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:08 devstack sudo[91916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:51:08 devstack sudo[91916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:09 devstack sudo[91916]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e5360829-0def-480a-856a-d2375f56fe28 tempest-ServerRescueNegativeTestJSON-802918399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.684s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:09 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-e5360829-0def-480a-856a-d2375f56fe28 tempest-ServerRescueNegativeTestJSON-802918399 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:51:09 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-e5360829-0def-480a-856a-d2375f56fe28 tempest-ServerRescueNegativeTestJSON-802918399 None] Deleted volume successfully. Sep 04 15:51:09 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e5360829-0def-480a-856a-d2375f56fe28 tempest-ServerRescueNegativeTestJSON-802918399 None] Lock "cinder-4f6970de-327d-4af3-b519-470a9aa939c1-delete_volume" released by "delete_volume" :: held 2.932s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:14 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:51:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Flow 'volume_create_manager' (8a85ca91-ce63-4cf3-88c0-003f15fade39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (475d16bc-58f0-47cf-a429-cd6cd5104efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (475d16bc-58f0-47cf-a429-cd6cd5104efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-398339893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9860bdc-2d8e-41a2-9f4b-592e0a8a8803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54ea94bd8604350a2869f125dd16519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:14Z,use_quota=True,user_id='1dfbfb6e95ec43c380f1beef633cd72f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e942de93-8243-4e36-ac71-5437403250b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e942de93-8243-4e36-ac71-5437403250b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c4893e7-deb0-42f0-bcb2-1c8c72e1b4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c4893e7-deb0-42f0-bcb2-1c8c72e1b4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9860bdc-2d8e-41a2-9f4b-592e0a8a8803', 'volume_name': 'volume-b9860bdc-2d8e-41a2-9f4b-592e0a8a8803', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a06680-ee4b-412e-af9c-c9528a2f228e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a06680-ee4b-412e-af9c-c9528a2f228e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1fa2956-3eae-4a00-867e-5264bfd67370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:14 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Volume b9860bdc-2d8e-41a2-9f4b-592e0a8a8803: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9860bdc-2d8e-41a2-9f4b-592e0a8a8803', 'volume_size': 1} Sep 04 15:51:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-398339893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9860bdc-2d8e-41a2-9f4b-592e0a8a8803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54ea94bd8604350a2869f125dd16519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:14Z,use_quota=True,user_id='1dfbfb6e95ec43c380f1beef633cd72f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:51:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Creating volume b9860bdc-2d8e-41a2-9f4b-592e0a8a8803 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:51:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:51:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:51:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:51:14 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:51:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b9860bdc-2d8e-41a2-9f4b-592e0a8a8803 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:14 devstack sudo[92041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b9860bdc-2d8e-41a2-9f4b-592e0a8a8803 1073741824 Sep 04 15:51:14 devstack sudo[92041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:15 devstack sudo[92041]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b9860bdc-2d8e-41a2-9f4b-592e0a8a8803 1073741824" returned: 0 in 1.027s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b9860bdc-2d8e-41a2-9f4b-592e0a8a8803 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:16 devstack sudo[92100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b9860bdc-2d8e-41a2-9f4b-592e0a8a8803 Sep 04 15:51:16 devstack sudo[92100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:16 devstack sudo[92100]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b9860bdc-2d8e-41a2-9f4b-592e0a8a8803" returned: 0 in 0.562s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:51:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1fa2956-3eae-4a00-867e-5264bfd67370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9860bdc-2d8e-41a2-9f4b-592e0a8a8803', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012aa3dc-f115-403f-b500-d342a85897c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:16 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Volume volume-b9860bdc-2d8e-41a2-9f4b-592e0a8a8803 (b9860bdc-2d8e-41a2-9f4b-592e0a8a8803): created successfully Sep 04 15:51:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012aa3dc-f115-403f-b500-d342a85897c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Flow 'volume_create_manager' (8a85ca91-ce63-4cf3-88c0-003f15fade39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:16 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-70768260-d164-4a85-9a6d-bb5e0728a3b9 tempest-AbsoluteLimitsTests-2046591572 None] Created volume successfully. Sep 04 15:51:17 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-df5f3946-8986-46ac-a425-1c6d95c4ced8 tempest-AbsoluteLimitsTests-2046591572 None] Acquiring lock "cinder-b9860bdc-2d8e-41a2-9f4b-592e0a8a8803-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:17 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-df5f3946-8986-46ac-a425-1c6d95c4ced8 tempest-AbsoluteLimitsTests-2046591572 None] Lock "cinder-b9860bdc-2d8e-41a2-9f4b-592e0a8a8803-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:17 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-df5f3946-8986-46ac-a425-1c6d95c4ced8 tempest-AbsoluteLimitsTests-2046591572 None] Acquiring lock "cinder-quobyte-b9860bdc-2d8e-41a2-9f4b-592e0a8a8803" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:17 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-df5f3946-8986-46ac-a425-1c6d95c4ced8 tempest-AbsoluteLimitsTests-2046591572 None] Lock "cinder-quobyte-b9860bdc-2d8e-41a2-9f4b-592e0a8a8803" acquired by "delete_volume" :: waited 0.032s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:17 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7174b7-e9c1-4ae0-89cd-fde6a5b795af]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-df5f3946-8986-46ac-a425-1c6d95c4ced8 tempest-AbsoluteLimitsTests-2046591572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b9860bdc-2d8e-41a2-9f4b-592e0a8a8803 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:18 devstack sudo[92130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b9860bdc-2d8e-41a2-9f4b-592e0a8a8803 Sep 04 15:51:18 devstack sudo[92130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:18 devstack sudo[92130]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-df5f3946-8986-46ac-a425-1c6d95c4ced8 tempest-AbsoluteLimitsTests-2046591572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b9860bdc-2d8e-41a2-9f4b-592e0a8a8803" returned: 0 in 0.786s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-df5f3946-8986-46ac-a425-1c6d95c4ced8 tempest-AbsoluteLimitsTests-2046591572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b9860bdc-2d8e-41a2-9f4b-592e0a8a8803 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:18 devstack sudo[92183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b9860bdc-2d8e-41a2-9f4b-592e0a8a8803 Sep 04 15:51:18 devstack sudo[92183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:19 devstack sudo[92183]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-df5f3946-8986-46ac-a425-1c6d95c4ced8 tempest-AbsoluteLimitsTests-2046591572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b9860bdc-2d8e-41a2-9f4b-592e0a8a8803" returned: 0 in 0.552s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-df5f3946-8986-46ac-a425-1c6d95c4ced8 tempest-AbsoluteLimitsTests-2046591572 None] Lock "cinder-quobyte-b9860bdc-2d8e-41a2-9f4b-592e0a8a8803" released by "delete_volume" :: held 1.429s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:19 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-df5f3946-8986-46ac-a425-1c6d95c4ced8 tempest-AbsoluteLimitsTests-2046591572 None] Created reservations ['2e2992bc-77cf-4679-a544-bf551ff378bf', 'a97c66f1-9cd4-49b5-b07d-f7ca590a6a51', 'a79a1ccd-af8e-47c9-820f-57e8d9ddc680', 'cfe37628-cb06-4f1f-8e28-3de7c56f2da4'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:51:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-df5f3946-8986-46ac-a425-1c6d95c4ced8 tempest-AbsoluteLimitsTests-2046591572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-df5f3946-8986-46ac-a425-1c6d95c4ced8 tempest-AbsoluteLimitsTests-2046591572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-df5f3946-8986-46ac-a425-1c6d95c4ced8 tempest-AbsoluteLimitsTests-2046591572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:51:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-df5f3946-8986-46ac-a425-1c6d95c4ced8 tempest-AbsoluteLimitsTests-2046591572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:51:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-df5f3946-8986-46ac-a425-1c6d95c4ced8 tempest-AbsoluteLimitsTests-2046591572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-df5f3946-8986-46ac-a425-1c6d95c4ced8 tempest-AbsoluteLimitsTests-2046591572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:19 devstack sudo[92200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:51:19 devstack sudo[92200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:20 devstack sudo[92200]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-df5f3946-8986-46ac-a425-1c6d95c4ced8 tempest-AbsoluteLimitsTests-2046591572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.463s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:20 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-df5f3946-8986-46ac-a425-1c6d95c4ced8 tempest-AbsoluteLimitsTests-2046591572 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:51:20 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-df5f3946-8986-46ac-a425-1c6d95c4ced8 tempest-AbsoluteLimitsTests-2046591572 None] Deleted volume successfully. Sep 04 15:51:20 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-df5f3946-8986-46ac-a425-1c6d95c4ced8 tempest-AbsoluteLimitsTests-2046591572 None] Lock "cinder-b9860bdc-2d8e-41a2-9f4b-592e0a8a8803-delete_volume" released by "delete_volume" :: held 2.415s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:26 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-ae1cbc0d-3d09-4abb-b24b-2e376e950f77 req-2763dbfb-04b1-46e9-9958-461021cb1a59 tempest-ServerActionsTestOtherA-270276429 None] Terminate volume connection completed successfully. Sep 04 15:51:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-ae1cbc0d-3d09-4abb-b24b-2e376e950f77 req-2763dbfb-04b1-46e9-9958-461021cb1a59 tempest-ServerActionsTestOtherA-270276429 None] Deleting attachment 1d1371d7-5ffb-4f69-b518-7bc7256eb239. {{(pid=87490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:51:26 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:51:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Flow 'volume_create_manager' (ae4c8753-3658-43e3-aab4-1dcbc6757080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4271f763-5f49-4731-9ff9-cbc56a83b4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4271f763-5f49-4731-9ff9-cbc56a83b4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2044930477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd085262-f7fd-4fa9-892a-acf0b571802a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea360455701e47ff887fa306d5d0d553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:27Z,use_quota=True,user_id='a114039904734e33b8260af4025d7f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ea8439-d9c6-4215-b04f-e28f740e74a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ea8439-d9c6-4215-b04f-e28f740e74a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e632839-47a7-4061-a9e5-6f69dfad323e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e632839-47a7-4061-a9e5-6f69dfad323e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd085262-f7fd-4fa9-892a-acf0b571802a', 'volume_name': 'volume-cd085262-f7fd-4fa9-892a-acf0b571802a', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb9ff87-d0fd-42df-8e2d-47a0ef854d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb9ff87-d0fd-42df-8e2d-47a0ef854d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b0526dc-7183-4897-a966-a3234f529392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:27 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Volume cd085262-f7fd-4fa9-892a-acf0b571802a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd085262-f7fd-4fa9-892a-acf0b571802a', 'volume_size': 1} Sep 04 15:51:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:27 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2044930477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd085262-f7fd-4fa9-892a-acf0b571802a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea360455701e47ff887fa306d5d0d553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:27Z,use_quota=True,user_id='a114039904734e33b8260af4025d7f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:51:27 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Creating volume cd085262-f7fd-4fa9-892a-acf0b571802a {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:51:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:27 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:51:27 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:51:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:27 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:51:27 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:51:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cd085262-f7fd-4fa9-892a-acf0b571802a 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:27 devstack sudo[92219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cd085262-f7fd-4fa9-892a-acf0b571802a 1073741824 Sep 04 15:51:27 devstack sudo[92219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:27 devstack sudo[92219]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cd085262-f7fd-4fa9-892a-acf0b571802a 1073741824" returned: 0 in 0.581s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cd085262-f7fd-4fa9-892a-acf0b571802a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:27 devstack sudo[92228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cd085262-f7fd-4fa9-892a-acf0b571802a Sep 04 15:51:27 devstack sudo[92228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:28 devstack sudo[92228]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cd085262-f7fd-4fa9-892a-acf0b571802a" returned: 0 in 0.607s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:28 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:51:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:28 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b0526dc-7183-4897-a966-a3234f529392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd085262-f7fd-4fa9-892a-acf0b571802a', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:28 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45cb5fde-fc23-4384-a70b-c50af0fa7ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:28 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Volume volume-cd085262-f7fd-4fa9-892a-acf0b571802a (cd085262-f7fd-4fa9-892a-acf0b571802a): created successfully Sep 04 15:51:28 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45cb5fde-fc23-4384-a70b-c50af0fa7ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:28 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Flow 'volume_create_manager' (ae4c8753-3658-43e3-aab4-1dcbc6757080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:28 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-55106216-ae23-4d3d-b43b-42e7b5415a7b tempest-VolumesMetadataTest-1014609481 None] Created volume successfully. Sep 04 15:51:30 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-84b1febe-b879-4f09-b6d1-636d1a0ec7ac tempest-VolumesMetadataTest-1014609481 None] Acquiring lock "cinder-cd085262-f7fd-4fa9-892a-acf0b571802a-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:30 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-84b1febe-b879-4f09-b6d1-636d1a0ec7ac tempest-VolumesMetadataTest-1014609481 None] Lock "cinder-cd085262-f7fd-4fa9-892a-acf0b571802a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:30 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-84b1febe-b879-4f09-b6d1-636d1a0ec7ac tempest-VolumesMetadataTest-1014609481 None] Acquiring lock "cinder-quobyte-cd085262-f7fd-4fa9-892a-acf0b571802a" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:30 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-84b1febe-b879-4f09-b6d1-636d1a0ec7ac tempest-VolumesMetadataTest-1014609481 None] Lock "cinder-quobyte-cd085262-f7fd-4fa9-892a-acf0b571802a" acquired by "delete_volume" :: waited 0.028s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:30 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5d47a7-c2dd-4a92-a8e5-2a11ff147a7d]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-84b1febe-b879-4f09-b6d1-636d1a0ec7ac tempest-VolumesMetadataTest-1014609481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cd085262-f7fd-4fa9-892a-acf0b571802a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:30 devstack sudo[92288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cd085262-f7fd-4fa9-892a-acf0b571802a Sep 04 15:51:30 devstack sudo[92288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:30 devstack sudo[92288]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-84b1febe-b879-4f09-b6d1-636d1a0ec7ac tempest-VolumesMetadataTest-1014609481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cd085262-f7fd-4fa9-892a-acf0b571802a" returned: 0 in 0.517s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-84b1febe-b879-4f09-b6d1-636d1a0ec7ac tempest-VolumesMetadataTest-1014609481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cd085262-f7fd-4fa9-892a-acf0b571802a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:30 devstack sudo[92296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cd085262-f7fd-4fa9-892a-acf0b571802a Sep 04 15:51:30 devstack sudo[92296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:31 devstack sudo[92296]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-84b1febe-b879-4f09-b6d1-636d1a0ec7ac tempest-VolumesMetadataTest-1014609481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cd085262-f7fd-4fa9-892a-acf0b571802a" returned: 0 in 0.317s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-84b1febe-b879-4f09-b6d1-636d1a0ec7ac tempest-VolumesMetadataTest-1014609481 None] Lock "cinder-quobyte-cd085262-f7fd-4fa9-892a-acf0b571802a" released by "delete_volume" :: held 0.893s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:31 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-84b1febe-b879-4f09-b6d1-636d1a0ec7ac tempest-VolumesMetadataTest-1014609481 None] Created reservations ['df1fd311-623a-4665-9c33-968f2adafd13', '4f9607d3-96d3-4ddd-ac9b-4deeaa71f15e', '58a21738-57ea-4ef2-acab-55d3a159ce83', 'b078aa3e-6003-4b6a-81c3-2ee5271802b6'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:51:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-84b1febe-b879-4f09-b6d1-636d1a0ec7ac tempest-VolumesMetadataTest-1014609481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-84b1febe-b879-4f09-b6d1-636d1a0ec7ac tempest-VolumesMetadataTest-1014609481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:31 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-84b1febe-b879-4f09-b6d1-636d1a0ec7ac tempest-VolumesMetadataTest-1014609481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:51:31 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-84b1febe-b879-4f09-b6d1-636d1a0ec7ac tempest-VolumesMetadataTest-1014609481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:51:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-84b1febe-b879-4f09-b6d1-636d1a0ec7ac tempest-VolumesMetadataTest-1014609481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-84b1febe-b879-4f09-b6d1-636d1a0ec7ac tempest-VolumesMetadataTest-1014609481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:31 devstack sudo[92299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:51:31 devstack sudo[92299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:31 devstack sudo[92299]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-84b1febe-b879-4f09-b6d1-636d1a0ec7ac tempest-VolumesMetadataTest-1014609481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.319s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:31 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-84b1febe-b879-4f09-b6d1-636d1a0ec7ac tempest-VolumesMetadataTest-1014609481 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:51:31 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-84b1febe-b879-4f09-b6d1-636d1a0ec7ac tempest-VolumesMetadataTest-1014609481 None] Deleted volume successfully. Sep 04 15:51:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-84b1febe-b879-4f09-b6d1-636d1a0ec7ac tempest-VolumesMetadataTest-1014609481 None] Lock "cinder-cd085262-f7fd-4fa9-892a-acf0b571802a-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:35 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:51:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Flow 'volume_create_manager' (f5c3ebed-e9a5-4988-9b77-5ca4e322c4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9795ce88-f522-45e9-9fb0-e5cabd1d5a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9795ce88-f522-45e9-9fb0-e5cabd1d5a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1030793546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0705951-f134-4442-aa5c-82f118dc0f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48f17c11f72e403a8d805da13bff5d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:35Z,use_quota=True,user_id='2463c3d2a8b74006a1f314ec63e4c849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (009ff226-cbca-462e-8708-1ab67818af5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (009ff226-cbca-462e-8708-1ab67818af5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee61de3-3f12-4142-b66f-8f233b7ac882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:35 devstack cinder-volume[87490]: DEBUG cinder.image.glance [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Creating Keystone auth plugin from conf {{(pid=87490) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 15:51:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee61de3-3f12-4142-b66f-8f233b7ac882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a0705951-f134-4442-aa5c-82f118dc0f34', 'volume_name': 'volume-a0705951-f134-4442-aa5c-82f118dc0f34', 'volume_size': 1, 'image_id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f11b89ae18364ea089a6f8a208910da3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'created_at': datetime.datetime(2026, 9, 4, 13, 42, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 42, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5558c17-c499-44af-95fb-afb0cb03a012/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d31928a-7336-49e2-aa22-bae4641651c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d31928a-7336-49e2-aa22-bae4641651c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca36d227-01ac-43db-966f-36f5566c9ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:35 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Volume a0705951-f134-4442-aa5c-82f118dc0f34: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a0705951-f134-4442-aa5c-82f118dc0f34', 'volume_size': 1, 'image_id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f11b89ae18364ea089a6f8a208910da3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'created_at': datetime.datetime(2026, 9, 4, 13, 42, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 42, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5558c17-c499-44af-95fb-afb0cb03a012/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 15:51:35 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Trying to clone a0705951-f134-4442-aa5c-82f118dc0f34 from image b5558c17-c499-44af-95fb-afb0cb03a012 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}]). {{(pid=87490) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 15:51:36 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_r8nc5xq3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 15:51:36 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Image download 20.69 MB at 20.69 MB/s Sep 04 15:51:36 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e18f96-a62b-44a9-aa00-d7066edeb7ab]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_r8nc5xq3devstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:36 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=63,cinder:UPDATE=90,cinder:INSERT=18,cinder:DELETE=3 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:51:36 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:51:36 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Flow 'volume_create_manager' (0742a229-27d2-4418-9313-af4e55bbcbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:36 devstack sudo[92323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_r8nc5xq3devstack@QuobyteHD Sep 04 15:51:36 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a4b9d2-fad3-411e-82b7-983a59a97720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:36 devstack sudo[92323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:36 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a4b9d2-fad3-411e-82b7-983a59a97720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1592865782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5863a194-2dca-467f-9e23-a48e006b15b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0eb3b5939824d8793786f1384b1e435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:37Z,use_quota=True,user_id='e2b02e4abe4f496d9ea848741b182ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:36 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f654082b-bbbd-48f0-b9e5-20b0fd5cc364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:36 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f654082b-bbbd-48f0-b9e5-20b0fd5cc364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:36 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80305d34-39c1-40cd-91a7-1f825472c09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:36 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80305d34-39c1-40cd-91a7-1f825472c09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5863a194-2dca-467f-9e23-a48e006b15b0', 'volume_name': 'volume-5863a194-2dca-467f-9e23-a48e006b15b0', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:36 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464145a3-f6bb-4c4f-97a3-8c31b8c18a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:36 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464145a3-f6bb-4c4f-97a3-8c31b8c18a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:36 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87105cc-5898-4cf4-8996-6321b6d26a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:36 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Volume 5863a194-2dca-467f-9e23-a48e006b15b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5863a194-2dca-467f-9e23-a48e006b15b0', 'volume_size': 1} Sep 04 15:51:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:36 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1592865782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5863a194-2dca-467f-9e23-a48e006b15b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0eb3b5939824d8793786f1384b1e435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:37Z,use_quota=True,user_id='e2b02e4abe4f496d9ea848741b182ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:51:36 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Creating volume 5863a194-2dca-467f-9e23-a48e006b15b0 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:51:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:36 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:51:36 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:51:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:36 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:51:36 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:51:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5863a194-2dca-467f-9e23-a48e006b15b0 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:37 devstack sudo[92325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5863a194-2dca-467f-9e23-a48e006b15b0 1073741824 Sep 04 15:51:37 devstack sudo[92325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:37 devstack sudo[92323]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_r8nc5xq3devstack@QuobyteHD" returned: 0 in 0.499s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:37 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Temporary image b5558c17-c499-44af-95fb-afb0cb03a012 is fetched for user 2463c3d2a8b74006a1f314ec63e4c849. {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 15:51:37 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=71,cinder:UPDATE=73,cinder:INSERT=17,cinder:DELETE=11 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:51:37 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75ef825-c03b-461f-9c48-0293c1547578]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_r8nc5xq3devstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:37 devstack sudo[92334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_r8nc5xq3devstack@QuobyteHD Sep 04 15:51:37 devstack sudo[92334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:37 devstack sudo[92325]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5863a194-2dca-467f-9e23-a48e006b15b0 1073741824" returned: 0 in 0.607s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5863a194-2dca-467f-9e23-a48e006b15b0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:37 devstack sudo[92337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5863a194-2dca-467f-9e23-a48e006b15b0 Sep 04 15:51:37 devstack sudo[92337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:37 devstack sudo[92334]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_r8nc5xq3devstack@QuobyteHD" returned: 0 in 0.512s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:38 devstack sudo[92337]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5863a194-2dca-467f-9e23-a48e006b15b0" returned: 0 in 0.361s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.105s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1030793546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0705951-f134-4442-aa5c-82f118dc0f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48f17c11f72e403a8d805da13bff5d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:35Z,use_quota=True,user_id='2463c3d2a8b74006a1f314ec63e4c849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Creating volume a0705951-f134-4442-aa5c-82f118dc0f34 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:51:38 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a0705951-f134-4442-aa5c-82f118dc0f34 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87105cc-5898-4cf4-8996-6321b6d26a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5863a194-2dca-467f-9e23-a48e006b15b0', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4903a7f-a813-4cd5-b518-8b3349371bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:38 devstack sudo[92344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a0705951-f134-4442-aa5c-82f118dc0f34 1073741824 Sep 04 15:51:38 devstack sudo[92344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:38 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Volume volume-5863a194-2dca-467f-9e23-a48e006b15b0 (5863a194-2dca-467f-9e23-a48e006b15b0): created successfully Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4903a7f-a813-4cd5-b518-8b3349371bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Flow 'volume_create_manager' (0742a229-27d2-4418-9313-af4e55bbcbc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:38 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-a61bc7ad-277e-4fa6-a94d-19abe5cae17c tempest-VolumesTransfersTest-1861719743 None] Created volume successfully. Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:38 devstack sudo[92346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:51:38 devstack sudo[92346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:38 devstack sudo[92346]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.299s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager._thread_info {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread count: 28 {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread info: [<_MainThread(MainThread, started 138899118923904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:51:38 devstack sudo[92344]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a0705951-f134-4442-aa5c-82f118dc0f34 1073741824" returned: 0 in 0.540s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a0705951-f134-4442-aa5c-82f118dc0f34 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:38 devstack sudo[92353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a0705951-f134-4442-aa5c-82f118dc0f34 Sep 04 15:51:38 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:38 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a0705951-f134-4442-aa5c-82f118dc0f34" returned: 0 in 0.297s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:38 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Attempting download of b5558c17-c499-44af-95fb-afb0cb03a012 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}])) to volume a0705951-f134-4442-aa5c-82f118dc0f34. {{(pid=87490) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 15:51:39 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0218e75-c3be-4cec-8256-f1cc116bcb11]: (4, 'raw') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_vvt4h6n1 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:39 devstack sudo[92356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_vvt4h6n1 Sep 04 15:51:39 devstack sudo[92356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:39 devstack sudo[92356]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_vvt4h6n1" returned: 0 in 0.402s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_vvt4h6n1 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:39 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-923c51f9-25b8-4257-8d0a-bfd412acd58f tempest-VolumesTransfersTest-1702718516 None] Transfer volume completed successfully. Sep 04 15:51:39 devstack sudo[92360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_vvt4h6n1 Sep 04 15:51:39 devstack sudo[92360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:39 devstack sudo[92360]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_vvt4h6n1" returned: 1 in 0.432s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_vvt4h6n1' failed. Not Retrying. {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:51:39 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08ed7d5-da25-4407-b115-744275da51ac]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_r8nc5xq3devstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:40 devstack sudo[92364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_r8nc5xq3devstack@QuobyteHD Sep 04 15:51:40 devstack sudo[92364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-37e40987-e63d-4dd0-bce2-4b2b548a67b6 tempest-VolumesTransfersTest-1915800378 None] Acquiring lock "cinder-5863a194-2dca-467f-9e23-a48e006b15b0-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-37e40987-e63d-4dd0-bce2-4b2b548a67b6 tempest-VolumesTransfersTest-1915800378 None] Lock "cinder-5863a194-2dca-467f-9e23-a48e006b15b0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-37e40987-e63d-4dd0-bce2-4b2b548a67b6 tempest-VolumesTransfersTest-1915800378 None] Acquiring lock "cinder-quobyte-5863a194-2dca-467f-9e23-a48e006b15b0" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-37e40987-e63d-4dd0-bce2-4b2b548a67b6 tempest-VolumesTransfersTest-1915800378 None] Lock "cinder-quobyte-5863a194-2dca-467f-9e23-a48e006b15b0" acquired by "delete_volume" :: waited 0.015s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:40 devstack sudo[92364]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:40 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa54ae9-a628-4336-a05a-be8329e9e86f]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-37e40987-e63d-4dd0-bce2-4b2b548a67b6 tempest-VolumesTransfersTest-1915800378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5863a194-2dca-467f-9e23-a48e006b15b0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_r8nc5xq3devstack@QuobyteHD" returned: 0 in 0.444s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:40 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] b5558c17-c499-44af-95fb-afb0cb03a012 was qcow2, converting to qcow2 {{(pid=87490) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 15:51:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_r8nc5xq3devstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a0705951-f134-4442-aa5c-82f118dc0f34 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:40 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_r8nc5xq3devstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a0705951-f134-4442-aa5c-82f118dc0f34 Sep 04 15:51:40 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:40 devstack sudo[92369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5863a194-2dca-467f-9e23-a48e006b15b0 Sep 04 15:51:40 devstack sudo[92369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:40 devstack sudo[92369]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-37e40987-e63d-4dd0-bce2-4b2b548a67b6 tempest-VolumesTransfersTest-1915800378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5863a194-2dca-467f-9e23-a48e006b15b0" returned: 0 in 0.589s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-37e40987-e63d-4dd0-bce2-4b2b548a67b6 tempest-VolumesTransfersTest-1915800378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5863a194-2dca-467f-9e23-a48e006b15b0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:40 devstack sudo[92382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5863a194-2dca-467f-9e23-a48e006b15b0 Sep 04 15:51:40 devstack sudo[92382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:41 devstack sudo[92382]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-37e40987-e63d-4dd0-bce2-4b2b548a67b6 tempest-VolumesTransfersTest-1915800378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5863a194-2dca-467f-9e23-a48e006b15b0" returned: 0 in 0.325s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:41 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-37e40987-e63d-4dd0-bce2-4b2b548a67b6 tempest-VolumesTransfersTest-1915800378 None] Lock "cinder-quobyte-5863a194-2dca-467f-9e23-a48e006b15b0" released by "delete_volume" :: held 0.975s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:41 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-37e40987-e63d-4dd0-bce2-4b2b548a67b6 tempest-VolumesTransfersTest-1915800378 None] Created reservations ['eeecd33f-71ad-47ab-91ba-cbdbafdc1780', '93d10e86-7448-44b1-b583-3b19d0ec4d6c', 'ff49a231-9603-4249-8fb1-04a66b60fdb5', '37abb044-00b6-49ad-bcf3-280343175f43'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:51:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-37e40987-e63d-4dd0-bce2-4b2b548a67b6 tempest-VolumesTransfersTest-1915800378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-37e40987-e63d-4dd0-bce2-4b2b548a67b6 tempest-VolumesTransfersTest-1915800378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:41 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-37e40987-e63d-4dd0-bce2-4b2b548a67b6 tempest-VolumesTransfersTest-1915800378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:51:41 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-37e40987-e63d-4dd0-bce2-4b2b548a67b6 tempest-VolumesTransfersTest-1915800378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:51:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-37e40987-e63d-4dd0-bce2-4b2b548a67b6 tempest-VolumesTransfersTest-1915800378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-37e40987-e63d-4dd0-bce2-4b2b548a67b6 tempest-VolumesTransfersTest-1915800378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:41 devstack sudo[92387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:51:41 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:41 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-37e40987-e63d-4dd0-bce2-4b2b548a67b6 tempest-VolumesTransfersTest-1915800378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.364s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:41 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-37e40987-e63d-4dd0-bce2-4b2b548a67b6 tempest-VolumesTransfersTest-1915800378 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:51:41 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-37e40987-e63d-4dd0-bce2-4b2b548a67b6 tempest-VolumesTransfersTest-1915800378 None] Deleted volume successfully. Sep 04 15:51:41 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-37e40987-e63d-4dd0-bce2-4b2b548a67b6 tempest-VolumesTransfersTest-1915800378 None] Lock "cinder-5863a194-2dca-467f-9e23-a48e006b15b0-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:41 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:51:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Flow 'volume_create_manager' (c2e996e4-f2a5-4623-9045-90f88f84dfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d9e1fd4-77f5-4777-863a-5dd662df44d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d9e1fd4-77f5-4777-863a-5dd662df44d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1728903556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d1b322-eda0-4370-8eb2-815cb373ae17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4663b8d2c23a45c6b3857ad82133ef82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:42Z,use_quota=True,user_id='27bca4c0c2aa4ce0920c9315587bde82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e7e1fcd-b070-4cfa-95d6-71e637937a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e7e1fcd-b070-4cfa-95d6-71e637937a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1182450f-10a0-4cd6-8499-66a13ab7bb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1182450f-10a0-4cd6-8499-66a13ab7bb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23d1b322-eda0-4370-8eb2-815cb373ae17', 'volume_name': 'volume-23d1b322-eda0-4370-8eb2-815cb373ae17', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7992ddb1-e5a0-4ca5-82ba-85782ee31461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7992ddb1-e5a0-4ca5-82ba-85782ee31461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b959ddf-435b-4d81-9689-a68e8f4bb522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:42 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Volume 23d1b322-eda0-4370-8eb2-815cb373ae17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23d1b322-eda0-4370-8eb2-815cb373ae17', 'volume_size': 1} Sep 04 15:51:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:42 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1728903556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d1b322-eda0-4370-8eb2-815cb373ae17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4663b8d2c23a45c6b3857ad82133ef82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:42Z,use_quota=True,user_id='27bca4c0c2aa4ce0920c9315587bde82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:51:42 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Creating volume 23d1b322-eda0-4370-8eb2-815cb373ae17 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:51:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:42 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:51:42 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:51:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:42 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:51:42 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:51:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-23d1b322-eda0-4370-8eb2-815cb373ae17 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:42 devstack sudo[92391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-23d1b322-eda0-4370-8eb2-815cb373ae17 1073741824 Sep 04 15:51:42 devstack sudo[92391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:42 devstack sudo[92391]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-23d1b322-eda0-4370-8eb2-815cb373ae17 1073741824" returned: 0 in 0.612s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-23d1b322-eda0-4370-8eb2-815cb373ae17 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:42 devstack sudo[92397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-23d1b322-eda0-4370-8eb2-815cb373ae17 Sep 04 15:51:42 devstack sudo[92397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:42 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_r8nc5xq3devstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a0705951-f134-4442-aa5c-82f118dc0f34" returned: 0 in 2.516s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:42 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_r8nc5xq3devstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a0705951-f134-4442-aa5c-82f118dc0f34 {{(pid=87490) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 15:51:42 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Converted 112.00 MB image at 44.38 MB/s Sep 04 15:51:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a0705951-f134-4442-aa5c-82f118dc0f34 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:42 devstack sudo[92399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a0705951-f134-4442-aa5c-82f118dc0f34 1G Sep 04 15:51:42 devstack sudo[92399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:43 devstack sudo[92397]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-23d1b322-eda0-4370-8eb2-815cb373ae17" returned: 0 in 0.385s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b959ddf-435b-4d81-9689-a68e8f4bb522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23d1b322-eda0-4370-8eb2-815cb373ae17', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca8b9cd-6535-47c3-ac34-933368599bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:43 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Volume volume-23d1b322-eda0-4370-8eb2-815cb373ae17 (23d1b322-eda0-4370-8eb2-815cb373ae17): created successfully Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca8b9cd-6535-47c3-ac34-933368599bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Flow 'volume_create_manager' (c2e996e4-f2a5-4623-9045-90f88f84dfdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:43 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-76943bbd-c76c-4320-bd42-b8fa713186e4 tempest-AttachVolumeNegativeTest-1388234156 None] Created volume successfully. Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Flow 'volume_create_manager' (d82f37b0-7c27-4994-b6d0-32b08f4d454f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (947ea131-a02c-4abd-b0d5-0066ccc9d4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (947ea131-a02c-4abd-b0d5-0066ccc9d4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-652887638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2757e507-d8d9-4f7d-b7c4-8e5873257991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0eb3b5939824d8793786f1384b1e435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:43Z,use_quota=True,user_id='e2b02e4abe4f496d9ea848741b182ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f78b5d0-7011-4803-9d3c-26d0567d409e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f78b5d0-7011-4803-9d3c-26d0567d409e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:43 devstack sudo[92399]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2bf9fc2-0a38-4304-9fd4-6288db5775c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2bf9fc2-0a38-4304-9fd4-6288db5775c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2757e507-d8d9-4f7d-b7c4-8e5873257991', 'volume_name': 'volume-2757e507-d8d9-4f7d-b7c4-8e5873257991', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fa57d4-5af2-4f0f-a182-efda41c39a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6fa57d4-5af2-4f0f-a182-efda41c39a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8334ea94-98e2-4ef7-b08c-da6b78efe192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:43 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Volume 2757e507-d8d9-4f7d-b7c4-8e5873257991: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2757e507-d8d9-4f7d-b7c4-8e5873257991', 'volume_size': 1} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-652887638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2757e507-d8d9-4f7d-b7c4-8e5873257991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0eb3b5939824d8793786f1384b1e435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:51:43Z,use_quota=True,user_id='e2b02e4abe4f496d9ea848741b182ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Creating volume 2757e507-d8d9-4f7d-b7c4-8e5873257991 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:51:43 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2757e507-d8d9-4f7d-b7c4-8e5873257991 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a0705951-f134-4442-aa5c-82f118dc0f34 1G" returned: 0 in 0.491s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Downloaded image b5558c17-c499-44af-95fb-afb0cb03a012 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}])) to volume a0705951-f134-4442-aa5c-82f118dc0f34 successfully. {{(pid=87490) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Temporary image b5558c17-c499-44af-95fb-afb0cb03a012 for user 2463c3d2a8b74006a1f314ec63e4c849 is deleted. {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Marking volume a0705951-f134-4442-aa5c-82f118dc0f34 as bootable. {{(pid=87490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 15:51:43 devstack sudo[92407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2757e507-d8d9-4f7d-b7c4-8e5873257991 1073741824 Sep 04 15:51:43 devstack sudo[92407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Copying metadata from image b5558c17-c499-44af-95fb-afb0cb03a012 to a0705951-f134-4442-aa5c-82f118dc0f34. {{(pid=87490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Creating volume glance metadata for volume a0705951-f134-4442-aa5c-82f118dc0f34 backed by image b5558c17-c499-44af-95fb-afb0cb03a012 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87490) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca36d227-01ac-43db-966f-36f5566c9ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0705951-f134-4442-aa5c-82f118dc0f34', 'volume_size': 1, 'image_id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f11b89ae18364ea089a6f8a208910da3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'created_at': datetime.datetime(2026, 9, 4, 13, 42, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 42, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5558c17-c499-44af-95fb-afb0cb03a012/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52034256-5e4b-4b53-8fe5-c3de5e25ff58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:43 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Volume volume-a0705951-f134-4442-aa5c-82f118dc0f34 (a0705951-f134-4442-aa5c-82f118dc0f34): created successfully Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52034256-5e4b-4b53-8fe5-c3de5e25ff58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Flow 'volume_create_manager' (f5c3ebed-e9a5-4988-9b77-5ca4e322c4ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:43 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-a405268f-6b77-4ed9-8584-686f737f7ee8 tempest-ServerActionsTestOtherA-270276429 None] Created volume successfully. Sep 04 15:51:43 devstack sudo[92407]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2757e507-d8d9-4f7d-b7c4-8e5873257991 1073741824" returned: 0 in 0.488s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2757e507-d8d9-4f7d-b7c4-8e5873257991 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:43 devstack sudo[92412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2757e507-d8d9-4f7d-b7c4-8e5873257991 Sep 04 15:51:43 devstack sudo[92412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:44 devstack sudo[92412]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2757e507-d8d9-4f7d-b7c4-8e5873257991" returned: 0 in 0.312s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:51:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8334ea94-98e2-4ef7-b08c-da6b78efe192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2757e507-d8d9-4f7d-b7c4-8e5873257991', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98dfd70-0679-4761-acd2-1c1cc03147d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:51:44 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Volume volume-2757e507-d8d9-4f7d-b7c4-8e5873257991 (2757e507-d8d9-4f7d-b7c4-8e5873257991): created successfully Sep 04 15:51:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98dfd70-0679-4761-acd2-1c1cc03147d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:51:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Flow 'volume_create_manager' (d82f37b0-7c27-4994-b6d0-32b08f4d454f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:51:44 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-7d7d4036-136c-47dc-b3fb-bb72b8046f64 tempest-VolumesTransfersTest-1861719743 None] Created volume successfully. Sep 04 15:51:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-13fab7fe-6828-4311-88c3-9157cee8e5b0 req-892631dd-4bde-4b18-99d8-c5775076ad3a tempest-AttachVolumeNegativeTest-1388234156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-13fab7fe-6828-4311-88c3-9157cee8e5b0 req-892631dd-4bde-4b18-99d8-c5775076ad3a tempest-AttachVolumeNegativeTest-1388234156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-13fab7fe-6828-4311-88c3-9157cee8e5b0 req-892631dd-4bde-4b18-99d8-c5775076ad3a tempest-AttachVolumeNegativeTest-1388234156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-13fab7fe-6828-4311-88c3-9157cee8e5b0 req-892631dd-4bde-4b18-99d8-c5775076ad3a tempest-AttachVolumeNegativeTest-1388234156 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787', 'name': 'volume-23d1b322-eda0-4370-8eb2-815cb373ae17', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46accfc1-9cc1-4a7f-8cfe-0ad6e0609f90', 'enforce_multipath': True} {{(pid=87490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:51:44 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-13fab7fe-6828-4311-88c3-9157cee8e5b0 req-892631dd-4bde-4b18-99d8-c5775076ad3a tempest-AttachVolumeNegativeTest-1388234156 None] attachment_update completed successfully. Sep 04 15:51:45 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-630a6efd-0ac7-4c31-90e0-93bf3e7657cf tempest-VolumesTransfersTest-1915800378 None] Acquiring lock "cinder-2757e507-d8d9-4f7d-b7c4-8e5873257991-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:45 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-630a6efd-0ac7-4c31-90e0-93bf3e7657cf tempest-VolumesTransfersTest-1915800378 None] Lock "cinder-2757e507-d8d9-4f7d-b7c4-8e5873257991-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:45 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-630a6efd-0ac7-4c31-90e0-93bf3e7657cf tempest-VolumesTransfersTest-1915800378 None] Acquiring lock "cinder-quobyte-2757e507-d8d9-4f7d-b7c4-8e5873257991" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:51:45 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-630a6efd-0ac7-4c31-90e0-93bf3e7657cf tempest-VolumesTransfersTest-1915800378 None] Lock "cinder-quobyte-2757e507-d8d9-4f7d-b7c4-8e5873257991" acquired by "delete_volume" :: waited 0.023s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:51:46 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe357138-4c1f-4b66-8e62-a69d718ff855]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:51:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-630a6efd-0ac7-4c31-90e0-93bf3e7657cf tempest-VolumesTransfersTest-1915800378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2757e507-d8d9-4f7d-b7c4-8e5873257991 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:46 devstack sudo[92823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2757e507-d8d9-4f7d-b7c4-8e5873257991 Sep 04 15:51:46 devstack sudo[92823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:46 devstack sudo[92823]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-630a6efd-0ac7-4c31-90e0-93bf3e7657cf tempest-VolumesTransfersTest-1915800378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2757e507-d8d9-4f7d-b7c4-8e5873257991" returned: 0 in 0.458s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-630a6efd-0ac7-4c31-90e0-93bf3e7657cf tempest-VolumesTransfersTest-1915800378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2757e507-d8d9-4f7d-b7c4-8e5873257991 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:46 devstack sudo[92830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2757e507-d8d9-4f7d-b7c4-8e5873257991 Sep 04 15:51:46 devstack sudo[92830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:46 devstack sudo[92830]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-630a6efd-0ac7-4c31-90e0-93bf3e7657cf tempest-VolumesTransfersTest-1915800378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2757e507-d8d9-4f7d-b7c4-8e5873257991" returned: 0 in 0.298s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:46 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-630a6efd-0ac7-4c31-90e0-93bf3e7657cf tempest-VolumesTransfersTest-1915800378 None] Lock "cinder-quobyte-2757e507-d8d9-4f7d-b7c4-8e5873257991" released by "delete_volume" :: held 0.831s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:46 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-630a6efd-0ac7-4c31-90e0-93bf3e7657cf tempest-VolumesTransfersTest-1915800378 None] Created reservations ['92039ca1-1b2d-4389-af3a-22baaec07f54', '03aec44f-d47f-4e42-81c4-eb5bd02ec44d', 'b58eed4e-ff38-4b58-8bc9-e470432ceb4e', '949ee5ce-c3fe-47c6-a7cb-92d2c08ba7ec'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:51:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-630a6efd-0ac7-4c31-90e0-93bf3e7657cf tempest-VolumesTransfersTest-1915800378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-630a6efd-0ac7-4c31-90e0-93bf3e7657cf tempest-VolumesTransfersTest-1915800378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:47 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-630a6efd-0ac7-4c31-90e0-93bf3e7657cf tempest-VolumesTransfersTest-1915800378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:51:47 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-630a6efd-0ac7-4c31-90e0-93bf3e7657cf tempest-VolumesTransfersTest-1915800378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:51:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-630a6efd-0ac7-4c31-90e0-93bf3e7657cf tempest-VolumesTransfersTest-1915800378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-630a6efd-0ac7-4c31-90e0-93bf3e7657cf tempest-VolumesTransfersTest-1915800378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:51:47 devstack sudo[92833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:51:47 devstack sudo[92833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:51:47 devstack sudo[92833]: pam_unix(sudo:session): session closed for user root Sep 04 15:51:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-630a6efd-0ac7-4c31-90e0-93bf3e7657cf tempest-VolumesTransfersTest-1915800378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.499s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:51:47 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-630a6efd-0ac7-4c31-90e0-93bf3e7657cf tempest-VolumesTransfersTest-1915800378 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:51:47 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-630a6efd-0ac7-4c31-90e0-93bf3e7657cf tempest-VolumesTransfersTest-1915800378 None] Deleted volume successfully. Sep 04 15:51:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-630a6efd-0ac7-4c31-90e0-93bf3e7657cf tempest-VolumesTransfersTest-1915800378 None] Lock "cinder-2757e507-d8d9-4f7d-b7c4-8e5873257991-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:51:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-461e2970-0ed0-4edc-9577-ca5d56d79cdf req-a8942dcc-8fe1-4b2b-8f00-1a8bd9a174a9 tempest-ServerActionsTestOtherA-270276429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:51:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-461e2970-0ed0-4edc-9577-ca5d56d79cdf req-a8942dcc-8fe1-4b2b-8f00-1a8bd9a174a9 tempest-ServerActionsTestOtherA-270276429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:51:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-461e2970-0ed0-4edc-9577-ca5d56d79cdf req-a8942dcc-8fe1-4b2b-8f00-1a8bd9a174a9 tempest-ServerActionsTestOtherA-270276429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:51:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-461e2970-0ed0-4edc-9577-ca5d56d79cdf req-a8942dcc-8fe1-4b2b-8f00-1a8bd9a174a9 tempest-ServerActionsTestOtherA-270276429 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787', 'name': 'volume-a0705951-f134-4442-aa5c-82f118dc0f34', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '897c1a07-0ead-4535-bc04-dc383e2db58a', 'enforce_multipath': True} {{(pid=87490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:51:48 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-461e2970-0ed0-4edc-9577-ca5d56d79cdf req-a8942dcc-8fe1-4b2b-8f00-1a8bd9a174a9 tempest-ServerActionsTestOtherA-270276429 None] attachment_update completed successfully. Sep 04 15:51:58 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:UPDATE=29,cinder:INSERT=13,cinder:SELECT=38,cinder:DELETE=1 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:51:58 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=35,cinder:INSERT=12,cinder:UPDATE=34,cinder:DELETE=5 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:52:19 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-7117f738-7d16-4ae4-8875-6a10a1291149 req-31c1a529-b6c2-4fdf-956c-cc094180c74b tempest-ServerActionsTestOtherA-270276429 None] Terminate volume connection completed successfully. Sep 04 15:52:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-7117f738-7d16-4ae4-8875-6a10a1291149 req-31c1a529-b6c2-4fdf-956c-cc094180c74b tempest-ServerActionsTestOtherA-270276429 None] Deleting attachment 897c1a07-0ead-4535-bc04-dc383e2db58a. {{(pid=87490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:52:22 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:52:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Flow 'volume_create_manager' (9650d7bd-06ce-44f4-af89-25681ed4b3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:52:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7a8f1a-c047-41af-8a79-54cef681837e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7a8f1a-c047-41af-8a79-54cef681837e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-321419234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee2f907-bcc3-48bc-9a84-884e99034127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce80b069786744fc84a213f235dfcf2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:52:22Z,use_quota=True,user_id='6c2de99b275f46bd9cd7dda83f69c299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1996024-ee0d-4d06-a521-867b979fadf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1996024-ee0d-4d06-a521-867b979fadf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a52f1d3-8f90-4298-8017-e96f859b1059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a52f1d3-8f90-4298-8017-e96f859b1059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ee2f907-bcc3-48bc-9a84-884e99034127', 'volume_name': 'volume-2ee2f907-bcc3-48bc-9a84-884e99034127', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (801764b9-6789-49aa-b943-50924dd9aefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (801764b9-6789-49aa-b943-50924dd9aefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5521a1-43b2-402f-b525-1b674ea17ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:22 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Volume 2ee2f907-bcc3-48bc-9a84-884e99034127: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ee2f907-bcc3-48bc-9a84-884e99034127', 'volume_size': 1} Sep 04 15:52:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-321419234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee2f907-bcc3-48bc-9a84-884e99034127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce80b069786744fc84a213f235dfcf2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:52:22Z,use_quota=True,user_id='6c2de99b275f46bd9cd7dda83f69c299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:52:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Creating volume 2ee2f907-bcc3-48bc-9a84-884e99034127 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:52:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:52:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:52:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:52:22 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:52:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2ee2f907-bcc3-48bc-9a84-884e99034127 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:22 devstack sudo[93206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2ee2f907-bcc3-48bc-9a84-884e99034127 1073741824 Sep 04 15:52:22 devstack sudo[93206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:23 devstack sudo[93206]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2ee2f907-bcc3-48bc-9a84-884e99034127 1073741824" returned: 0 in 0.822s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-7117f738-7d16-4ae4-8875-6a10a1291149 req-3393e32e-5243-4631-96e4-4c9db1644f49 tempest-ServerActionsTestOtherA-270276429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2ee2f907-bcc3-48bc-9a84-884e99034127 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:23 devstack sudo[93221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2ee2f907-bcc3-48bc-9a84-884e99034127 Sep 04 15:52:23 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Flow 'volume_create_manager' (d397c8df-6d49-4947-981d-a6147cd37653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7baf5f72-119e-49fa-9263-590e67bfd75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7baf5f72-119e-49fa-9263-590e67bfd75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1497594747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7612c895-1883-4e83-b3fe-1d8bf346fb2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20c6561564db4f4986c6b48e8edfd0c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:52:23Z,use_quota=True,user_id='b800d11445e041fa8875281682badf85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41cc621a-2dd5-44c0-8cfa-337e634729e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41cc621a-2dd5-44c0-8cfa-337e634729e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca25c719-89aa-4dce-8505-4bc98c9cd2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca25c719-89aa-4dce-8505-4bc98c9cd2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7612c895-1883-4e83-b3fe-1d8bf346fb2d', 'volume_name': 'volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df4bad4a-5c2a-4202-8b3d-b8fe8df5fe15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df4bad4a-5c2a-4202-8b3d-b8fe8df5fe15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a16ef4-9138-416e-877f-c00f26b2fe7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:23 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Volume 7612c895-1883-4e83-b3fe-1d8bf346fb2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d', 'volume_size': 1} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:23 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2ee2f907-bcc3-48bc-9a84-884e99034127" returned: 0 in 0.309s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-7117f738-7d16-4ae4-8875-6a10a1291149 req-3393e32e-5243-4631-96e4-4c9db1644f49 tempest-ServerActionsTestOtherA-270276429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.362s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-7117f738-7d16-4ae4-8875-6a10a1291149 req-3393e32e-5243-4631-96e4-4c9db1644f49 tempest-ServerActionsTestOtherA-270276429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.061s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1497594747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7612c895-1883-4e83-b3fe-1d8bf346fb2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20c6561564db4f4986c6b48e8edfd0c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:52:23Z,use_quota=True,user_id='b800d11445e041fa8875281682badf85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Creating volume 7612c895-1883-4e83-b3fe-1d8bf346fb2d {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:52:23 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5521a1-43b2-402f-b525-1b674ea17ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ee2f907-bcc3-48bc-9a84-884e99034127', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f898a1a6-faa8-494b-8e90-d6f6e3c47a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:23 devstack sudo[93224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d 1073741824 Sep 04 15:52:23 devstack sudo[93224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:23 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Volume volume-2ee2f907-bcc3-48bc-9a84-884e99034127 (2ee2f907-bcc3-48bc-9a84-884e99034127): created successfully Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f898a1a6-faa8-494b-8e90-d6f6e3c47a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Flow 'volume_create_manager' (9650d7bd-06ce-44f4-af89-25681ed4b3d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:52:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-7117f738-7d16-4ae4-8875-6a10a1291149 req-3393e32e-5243-4631-96e4-4c9db1644f49 tempest-ServerActionsTestOtherA-270276429 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787', 'name': 'volume-a0705951-f134-4442-aa5c-82f118dc0f34', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3fa3dc2f-cccd-44b7-87c2-9afebd55a5d4', 'enforce_multipath': True} {{(pid=87490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:52:23 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-3ef519fb-63fe-4a58-806c-22e5804d0f77 tempest-AttachVolumeTestJSON-680909899 None] Created volume successfully. Sep 04 15:52:23 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-7117f738-7d16-4ae4-8875-6a10a1291149 req-3393e32e-5243-4631-96e4-4c9db1644f49 tempest-ServerActionsTestOtherA-270276429 None] attachment_update completed successfully. Sep 04 15:52:24 devstack sudo[93224]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d 1073741824" returned: 0 in 0.757s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:24 devstack sudo[93285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d Sep 04 15:52:24 devstack sudo[93285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:24 devstack sudo[93285]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d" returned: 0 in 0.460s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:24 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:52:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:24 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a16ef4-9138-416e-877f-c00f26b2fe7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffede40a-1f5a-4795-a5c1-9cfe7c8862ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:52:25 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Volume volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d (7612c895-1883-4e83-b3fe-1d8bf346fb2d): created successfully Sep 04 15:52:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffede40a-1f5a-4795-a5c1-9cfe7c8862ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:52:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Flow 'volume_create_manager' (d397c8df-6d49-4947-981d-a6147cd37653) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:52:25 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-67741691-eff9-4409-a1d6-e11480c23bba tempest-VolumesActionsTest-1803198185 None] Created volume successfully. Sep 04 15:52:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-2827dbf7-6f27-4ed4-ac46-cd80c74239da req-995046f2-0433-4ff9-9755-d9d627d6f586 tempest-AttachVolumeTestJSON-680909899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-2827dbf7-6f27-4ed4-ac46-cd80c74239da req-995046f2-0433-4ff9-9755-d9d627d6f586 tempest-AttachVolumeTestJSON-680909899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-2827dbf7-6f27-4ed4-ac46-cd80c74239da req-995046f2-0433-4ff9-9755-d9d627d6f586 tempest-AttachVolumeTestJSON-680909899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-2827dbf7-6f27-4ed4-ac46-cd80c74239da req-995046f2-0433-4ff9-9755-d9d627d6f586 tempest-AttachVolumeTestJSON-680909899 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787', 'name': 'volume-2ee2f907-bcc3-48bc-9a84-884e99034127', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b4af787b-a7ba-4f6e-8ccb-b41f5dd42009', 'enforce_multipath': True} {{(pid=87490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:52:25 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-2827dbf7-6f27-4ed4-ac46-cd80c74239da req-995046f2-0433-4ff9-9755-d9d627d6f586 tempest-AttachVolumeTestJSON-680909899 None] attachment_update completed successfully. Sep 04 15:52:35 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=17,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:52:35 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=19,cinder:INSERT=2,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:52:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:52:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:52:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:52:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:52:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:52:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:52:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:52:38 devstack sudo[93535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:52:38 devstack sudo[93535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:52:39 devstack sudo[93535]: pam_unix(sudo:session): session closed for user root Sep 04 15:52:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 1.138s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:52:39 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:52:39 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager._thread_info {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:52:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread count: 28 {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:52:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread info: [<_MainThread(MainThread, started 138899118923904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:52:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b5965163-fb0f-42a4-996d-8cb232901382 tempest-VolumesActionsTest-1803198185 None] Acquiring lock "cinder-7612c895-1883-4e83-b3fe-1d8bf346fb2d" by "attach_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:52:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b5965163-fb0f-42a4-996d-8cb232901382 tempest-VolumesActionsTest-1803198185 None] Lock "cinder-7612c895-1883-4e83-b3fe-1d8bf346fb2d" acquired by "attach_volume" :: waited 0.029s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:52:40 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-b5965163-fb0f-42a4-996d-8cb232901382 tempest-VolumesActionsTest-1803198185 None] Attaching volume 7612c895-1883-4e83-b3fe-1d8bf346fb2d to instance a3594ce1-673a-4ca4-8103-15f5012a60af at mountpoint /dev/vdb on host None. Sep 04 15:52:41 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-b5965163-fb0f-42a4-996d-8cb232901382 tempest-VolumesActionsTest-1803198185 None] Attach volume completed successfully. Sep 04 15:52:41 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b5965163-fb0f-42a4-996d-8cb232901382 tempest-VolumesActionsTest-1803198185 None] Lock "cinder-7612c895-1883-4e83-b3fe-1d8bf346fb2d" released by "attach_volume" :: held 0.180s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:52:41 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c0af1620-8ad3-49db-8488-f1253c63bea1 tempest-VolumesActionsTest-1803198185 None] Acquiring lock "cinder-7612c895-1883-4e83-b3fe-1d8bf346fb2d-detach_volume" by "detach_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:52:41 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c0af1620-8ad3-49db-8488-f1253c63bea1 tempest-VolumesActionsTest-1803198185 None] Lock "cinder-7612c895-1883-4e83-b3fe-1d8bf346fb2d-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:52:41 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-c0af1620-8ad3-49db-8488-f1253c63bea1 tempest-VolumesActionsTest-1803198185 None] Detaching volume 7612c895-1883-4e83-b3fe-1d8bf346fb2d from instance a3594ce1-673a-4ca4-8103-15f5012a60af. Sep 04 15:52:41 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-c0af1620-8ad3-49db-8488-f1253c63bea1 tempest-VolumesActionsTest-1803198185 None] Detach volume completed successfully. Sep 04 15:52:41 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c0af1620-8ad3-49db-8488-f1253c63bea1 tempest-VolumesActionsTest-1803198185 None] Lock "cinder-7612c895-1883-4e83-b3fe-1d8bf346fb2d-detach_volume" released by "detach_volume" :: held 0.193s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:52:46 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-1883aa53-70e9-43e7-8afb-3ca7b5a8c198 req-c3d9ceb9-8b25-4a9e-bf7b-9b15a1342d94 tempest-AttachVolumeNegativeTest-1388234156 None] Terminate volume connection completed successfully. Sep 04 15:52:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-1883aa53-70e9-43e7-8afb-3ca7b5a8c198 req-c3d9ceb9-8b25-4a9e-bf7b-9b15a1342d94 tempest-AttachVolumeNegativeTest-1388234156 None] Deleting attachment 46accfc1-9cc1-4a7f-8cfe-0ad6e0609f90. {{(pid=87490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:52:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d89d049c-caf1-4022-97af-ae441140e5d8 tempest-VolumesActionsTest-1803198185 None] Acquiring lock "cinder-7612c895-1883-4e83-b3fe-1d8bf346fb2d" by "attach_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:52:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d89d049c-caf1-4022-97af-ae441140e5d8 tempest-VolumesActionsTest-1803198185 None] Lock "cinder-7612c895-1883-4e83-b3fe-1d8bf346fb2d" acquired by "attach_volume" :: waited 0.027s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:52:55 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-d89d049c-caf1-4022-97af-ae441140e5d8 tempest-VolumesActionsTest-1803198185 None] Attaching volume 7612c895-1883-4e83-b3fe-1d8bf346fb2d to instance b5b33d2f-1608-4f23-bdae-54964f0e6f31 at mountpoint /dev/vdb on host None. Sep 04 15:52:55 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-d89d049c-caf1-4022-97af-ae441140e5d8 tempest-VolumesActionsTest-1803198185 None] Attach volume completed successfully. Sep 04 15:52:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d89d049c-caf1-4022-97af-ae441140e5d8 tempest-VolumesActionsTest-1803198185 None] Lock "cinder-7612c895-1883-4e83-b3fe-1d8bf346fb2d" released by "attach_volume" :: held 0.104s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:52:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-9d328a96-cdbc-45b1-a67f-0d164c5074c3 tempest-VolumesActionsTest-1803198185 None] Acquiring lock "cinder-7612c895-1883-4e83-b3fe-1d8bf346fb2d-detach_volume" by "detach_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:52:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-9d328a96-cdbc-45b1-a67f-0d164c5074c3 tempest-VolumesActionsTest-1803198185 None] Lock "cinder-7612c895-1883-4e83-b3fe-1d8bf346fb2d-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:52:56 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-9d328a96-cdbc-45b1-a67f-0d164c5074c3 tempest-VolumesActionsTest-1803198185 None] Detaching volume 7612c895-1883-4e83-b3fe-1d8bf346fb2d from instance b5b33d2f-1608-4f23-bdae-54964f0e6f31. Sep 04 15:52:56 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-9d328a96-cdbc-45b1-a67f-0d164c5074c3 tempest-VolumesActionsTest-1803198185 None] Detach volume completed successfully. Sep 04 15:52:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-9d328a96-cdbc-45b1-a67f-0d164c5074c3 tempest-VolumesActionsTest-1803198185 None] Lock "cinder-7612c895-1883-4e83-b3fe-1d8bf346fb2d-detach_volume" released by "detach_volume" :: held 0.094s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:00 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-3f332246-e19a-4626-a3be-4bbb1768e980 req-80bb8e67-1b2a-4522-82ac-0d897bc0c58e tempest-ServerActionsTestOtherA-270276429 None] Terminate volume connection completed successfully. Sep 04 15:53:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-3f332246-e19a-4626-a3be-4bbb1768e980 req-80bb8e67-1b2a-4522-82ac-0d897bc0c58e tempest-ServerActionsTestOtherA-270276429 None] Deleting attachment 3fa3dc2f-cccd-44b7-87c2-9afebd55a5d4. {{(pid=87490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:53:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-3f332246-e19a-4626-a3be-4bbb1768e980 req-888417c4-0572-41d7-80a3-382e507837d4 tempest-ServerActionsTestOtherA-270276429 None] Acquiring lock "cinder-a0705951-f134-4442-aa5c-82f118dc0f34-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-3f332246-e19a-4626-a3be-4bbb1768e980 req-888417c4-0572-41d7-80a3-382e507837d4 tempest-ServerActionsTestOtherA-270276429 None] Lock "cinder-a0705951-f134-4442-aa5c-82f118dc0f34-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-3f332246-e19a-4626-a3be-4bbb1768e980 req-888417c4-0572-41d7-80a3-382e507837d4 tempest-ServerActionsTestOtherA-270276429 None] Acquiring lock "cinder-quobyte-a0705951-f134-4442-aa5c-82f118dc0f34" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-3f332246-e19a-4626-a3be-4bbb1768e980 req-888417c4-0572-41d7-80a3-382e507837d4 tempest-ServerActionsTestOtherA-270276429 None] Lock "cinder-quobyte-a0705951-f134-4442-aa5c-82f118dc0f34" acquired by "delete_volume" :: waited 0.077s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:01 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0e7167-dd56-4e49-8301-621e1c10dd7d]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-3f332246-e19a-4626-a3be-4bbb1768e980 req-888417c4-0572-41d7-80a3-382e507837d4 tempest-ServerActionsTestOtherA-270276429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a0705951-f134-4442-aa5c-82f118dc0f34 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:01 devstack sudo[93893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a0705951-f134-4442-aa5c-82f118dc0f34 Sep 04 15:53:01 devstack sudo[93893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a2cc69e5-fcb8-4a8a-8b78-8fd7c0c746fb tempest-VolumesActionsTest-1803198185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a2cc69e5-fcb8-4a8a-8b78-8fd7c0c746fb tempest-VolumesActionsTest-1803198185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:02 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c5b6287e-4356-4f32-a7f8-5a7cc7a6c906 tempest-ServerActionsTestOtherA-270276429 None] Acquiring lock "cinder-8e89698b-eada-4dc8-8585-483e23a25218-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:02 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27baa44-2662-4d74-8f37-983036def510]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a2cc69e5-fcb8-4a8a-8b78-8fd7c0c746fb tempest-VolumesActionsTest-1803198185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:02 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c5b6287e-4356-4f32-a7f8-5a7cc7a6c906 tempest-ServerActionsTestOtherA-270276429 None] Lock "cinder-8e89698b-eada-4dc8-8585-483e23a25218-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:02 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c5b6287e-4356-4f32-a7f8-5a7cc7a6c906 tempest-ServerActionsTestOtherA-270276429 None] Acquiring lock "cinder-quobyte-8e89698b-eada-4dc8-8585-483e23a25218" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:02 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c5b6287e-4356-4f32-a7f8-5a7cc7a6c906 tempest-ServerActionsTestOtherA-270276429 None] Lock "cinder-quobyte-8e89698b-eada-4dc8-8585-483e23a25218" acquired by "delete_volume" :: waited 0.027s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:02 devstack sudo[93893]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-3f332246-e19a-4626-a3be-4bbb1768e980 req-888417c4-0572-41d7-80a3-382e507837d4 tempest-ServerActionsTestOtherA-270276429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a0705951-f134-4442-aa5c-82f118dc0f34" returned: 0 in 0.761s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-3f332246-e19a-4626-a3be-4bbb1768e980 req-888417c4-0572-41d7-80a3-382e507837d4 tempest-ServerActionsTestOtherA-270276429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a0705951-f134-4442-aa5c-82f118dc0f34 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:02 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d Sep 04 15:53:02 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:02 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabe7c15-67e8-41a9-ae50-30c29bb7b85d]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c5b6287e-4356-4f32-a7f8-5a7cc7a6c906 tempest-ServerActionsTestOtherA-270276429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8e89698b-eada-4dc8-8585-483e23a25218 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:02 devstack sudo[93901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a0705951-f134-4442-aa5c-82f118dc0f34 Sep 04 15:53:02 devstack sudo[93901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:02 devstack sudo[93903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8e89698b-eada-4dc8-8585-483e23a25218 Sep 04 15:53:02 devstack sudo[93903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:02 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a2cc69e5-fcb8-4a8a-8b78-8fd7c0c746fb tempest-VolumesActionsTest-1803198185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d" returned: 0 in 0.518s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:02 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd32ba6-87f7-4b5c-b45e-ce13d578af53]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a2cc69e5-fcb8-4a8a-8b78-8fd7c0c746fb tempest-VolumesActionsTest-1803198185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:02 devstack sudo[93901]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-3f332246-e19a-4626-a3be-4bbb1768e980 req-888417c4-0572-41d7-80a3-382e507837d4 tempest-ServerActionsTestOtherA-270276429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a0705951-f134-4442-aa5c-82f118dc0f34" returned: 0 in 0.396s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:02 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-3f332246-e19a-4626-a3be-4bbb1768e980 req-888417c4-0572-41d7-80a3-382e507837d4 tempest-ServerActionsTestOtherA-270276429 None] Lock "cinder-quobyte-a0705951-f134-4442-aa5c-82f118dc0f34" released by "delete_volume" :: held 1.280s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:02 devstack cinder-volume[87490]: DEBUG cinder.quota [req-3f332246-e19a-4626-a3be-4bbb1768e980 req-888417c4-0572-41d7-80a3-382e507837d4 tempest-ServerActionsTestOtherA-270276429 None] Created reservations ['2fea4262-6ec7-4ab2-8366-5fd542e7a7e3', 'c8b08658-2722-4873-a30c-2c1e842e7b93', 'beb67e27-97c4-4c20-a438-00accd1d7796', 'b834fa3f-d9e7-4b2c-8d7a-3788c6e70606'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:53:02 devstack sudo[93909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d Sep 04 15:53:02 devstack sudo[93909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-3f332246-e19a-4626-a3be-4bbb1768e980 req-888417c4-0572-41d7-80a3-382e507837d4 tempest-ServerActionsTestOtherA-270276429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-3f332246-e19a-4626-a3be-4bbb1768e980 req-888417c4-0572-41d7-80a3-382e507837d4 tempest-ServerActionsTestOtherA-270276429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [req-3f332246-e19a-4626-a3be-4bbb1768e980 req-888417c4-0572-41d7-80a3-382e507837d4 tempest-ServerActionsTestOtherA-270276429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:53:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [req-3f332246-e19a-4626-a3be-4bbb1768e980 req-888417c4-0572-41d7-80a3-382e507837d4 tempest-ServerActionsTestOtherA-270276429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:53:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-3f332246-e19a-4626-a3be-4bbb1768e980 req-888417c4-0572-41d7-80a3-382e507837d4 tempest-ServerActionsTestOtherA-270276429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-3f332246-e19a-4626-a3be-4bbb1768e980 req-888417c4-0572-41d7-80a3-382e507837d4 tempest-ServerActionsTestOtherA-270276429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:03 devstack sudo[93914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:53:03 devstack sudo[93914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:03 devstack sudo[93903]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c5b6287e-4356-4f32-a7f8-5a7cc7a6c906 tempest-ServerActionsTestOtherA-270276429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8e89698b-eada-4dc8-8585-483e23a25218" returned: 0 in 0.598s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c5b6287e-4356-4f32-a7f8-5a7cc7a6c906 tempest-ServerActionsTestOtherA-270276429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8e89698b-eada-4dc8-8585-483e23a25218 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:03 devstack sudo[93916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8e89698b-eada-4dc8-8585-483e23a25218 Sep 04 15:53:03 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:03 devstack sudo[93909]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a2cc69e5-fcb8-4a8a-8b78-8fd7c0c746fb tempest-VolumesActionsTest-1803198185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d" returned: 0 in 0.534s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a2cc69e5-fcb8-4a8a-8b78-8fd7c0c746fb tempest-VolumesActionsTest-1803198185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d /opt/stack/data/cinder/conversion/7612c895-1883-4e83-b3fe-1d8bf346fb2d.temp_image.e738fe53-7b9a-446e-a53c-0e6073b2177coj7o68u5.img {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:03 devstack sudo[93914]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-3f332246-e19a-4626-a3be-4bbb1768e980 req-888417c4-0572-41d7-80a3-382e507837d4 tempest-ServerActionsTestOtherA-270276429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.368s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:03 devstack cinder-volume[87490]: DEBUG cinder.manager [req-3f332246-e19a-4626-a3be-4bbb1768e980 req-888417c4-0572-41d7-80a3-382e507837d4 tempest-ServerActionsTestOtherA-270276429 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:53:03 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d /opt/stack/data/cinder/conversion/7612c895-1883-4e83-b3fe-1d8bf346fb2d.temp_image.e738fe53-7b9a-446e-a53c-0e6073b2177coj7o68u5.img Sep 04 15:53:03 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:03 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-3f332246-e19a-4626-a3be-4bbb1768e980 req-888417c4-0572-41d7-80a3-382e507837d4 tempest-ServerActionsTestOtherA-270276429 None] Deleted volume successfully. Sep 04 15:53:03 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c5b6287e-4356-4f32-a7f8-5a7cc7a6c906 tempest-ServerActionsTestOtherA-270276429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8e89698b-eada-4dc8-8585-483e23a25218" returned: 0 in 0.330s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c5b6287e-4356-4f32-a7f8-5a7cc7a6c906 tempest-ServerActionsTestOtherA-270276429 None] Lock "cinder-quobyte-8e89698b-eada-4dc8-8585-483e23a25218" released by "delete_volume" :: held 0.995s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-3f332246-e19a-4626-a3be-4bbb1768e980 req-888417c4-0572-41d7-80a3-382e507837d4 tempest-ServerActionsTestOtherA-270276429 None] Lock "cinder-a0705951-f134-4442-aa5c-82f118dc0f34-delete_volume" released by "delete_volume" :: held 2.032s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:03 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-c5b6287e-4356-4f32-a7f8-5a7cc7a6c906 tempest-ServerActionsTestOtherA-270276429 None] Created reservations ['dfdd8961-2d2a-4c2b-854a-83b020bf8358', '5350e7f1-9e0e-4a01-8072-dd145c8056a5', '4a713494-a416-4c71-b8a5-734fcb84d784', 'a31cba03-cff0-4f31-b50e-4d654728bf0c'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:53:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c5b6287e-4356-4f32-a7f8-5a7cc7a6c906 tempest-ServerActionsTestOtherA-270276429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c5b6287e-4356-4f32-a7f8-5a7cc7a6c906 tempest-ServerActionsTestOtherA-270276429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c5b6287e-4356-4f32-a7f8-5a7cc7a6c906 tempest-ServerActionsTestOtherA-270276429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:53:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c5b6287e-4356-4f32-a7f8-5a7cc7a6c906 tempest-ServerActionsTestOtherA-270276429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:53:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c5b6287e-4356-4f32-a7f8-5a7cc7a6c906 tempest-ServerActionsTestOtherA-270276429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c5b6287e-4356-4f32-a7f8-5a7cc7a6c906 tempest-ServerActionsTestOtherA-270276429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:03 devstack sudo[93926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:53:03 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:03 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c5b6287e-4356-4f32-a7f8-5a7cc7a6c906 tempest-ServerActionsTestOtherA-270276429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.341s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:03 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-c5b6287e-4356-4f32-a7f8-5a7cc7a6c906 tempest-ServerActionsTestOtherA-270276429 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:53:03 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-c5b6287e-4356-4f32-a7f8-5a7cc7a6c906 tempest-ServerActionsTestOtherA-270276429 None] Deleted volume successfully. Sep 04 15:53:04 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c5b6287e-4356-4f32-a7f8-5a7cc7a6c906 tempest-ServerActionsTestOtherA-270276429 None] Lock "cinder-8e89698b-eada-4dc8-8585-483e23a25218-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:10 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a2cc69e5-fcb8-4a8a-8b78-8fd7c0c746fb tempest-VolumesActionsTest-1803198185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d /opt/stack/data/cinder/conversion/7612c895-1883-4e83-b3fe-1d8bf346fb2d.temp_image.e738fe53-7b9a-446e-a53c-0e6073b2177coj7o68u5.img" returned: 0 in 7.439s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:10 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e2a29d-e59d-471b-919e-aa0d31767cf3]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a2cc69e5-fcb8-4a8a-8b78-8fd7c0c746fb tempest-VolumesActionsTest-1803198185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:10 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d Sep 04 15:53:10 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:11 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a2cc69e5-fcb8-4a8a-8b78-8fd7c0c746fb tempest-VolumesActionsTest-1803198185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d" returned: 0 in 0.776s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:11 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-a2cc69e5-fcb8-4a8a-8b78-8fd7c0c746fb tempest-VolumesActionsTest-1803198185 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d, size 1024.00 MB, duration 7.44 sec, destination /opt/stack/data/cinder/conversion/7612c895-1883-4e83-b3fe-1d8bf346fb2d.temp_image.e738fe53-7b9a-446e-a53c-0e6073b2177coj7o68u5.img {{(pid=87490) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 15:53:11 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-a2cc69e5-fcb8-4a8a-8b78-8fd7c0c746fb tempest-VolumesActionsTest-1803198185 None] Converted 1024.00 MB image at 137.61 MB/s Sep 04 15:53:11 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-a2cc69e5-fcb8-4a8a-8b78-8fd7c0c746fb tempest-VolumesActionsTest-1803198185 None] e738fe53-7b9a-446e-a53c-0e6073b2177c was raw, no need to convert to raw {{(pid=87490) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 04 15:53:14 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=29,cinder:UPDATE=26,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:53:16 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-f2dcdce9-fca2-436a-b068-35bd75fc014b req-98915cb1-162a-4a95-b0d0-bedc1d2f4e35 tempest-AttachVolumeTestJSON-680909899 None] Terminate volume connection completed successfully. Sep 04 15:53:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-f2dcdce9-fca2-436a-b068-35bd75fc014b req-98915cb1-162a-4a95-b0d0-bedc1d2f4e35 tempest-AttachVolumeTestJSON-680909899 None] Deleting attachment b4af787b-a7ba-4f6e-8ccb-b41f5dd42009. {{(pid=87490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:53:31 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=3 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:53:31 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:INSERT=9,cinder:SELECT=24,cinder:UPDATE=19,cinder:DELETE=1 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:53:32 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:53:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Flow 'volume_create_manager' (7fbb25fe-e352-496f-aa5a-4627aeb1e347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:53:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (064b880d-79d5-4c48-a006-03468898d79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (064b880d-79d5-4c48-a006-03468898d79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-116614915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a270cea7-4f42-4ed6-8396-680038747fff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4663b8d2c23a45c6b3857ad82133ef82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:32Z,use_quota=True,user_id='27bca4c0c2aa4ce0920c9315587bde82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e5c6ac-1965-47db-906f-1893e3367c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e5c6ac-1965-47db-906f-1893e3367c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af9dd2a-9991-4a88-8f58-bc0176eaf298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af9dd2a-9991-4a88-8f58-bc0176eaf298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a270cea7-4f42-4ed6-8396-680038747fff', 'volume_name': 'volume-a270cea7-4f42-4ed6-8396-680038747fff', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592afd90-cf4b-495f-869f-27c440c7d41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592afd90-cf4b-495f-869f-27c440c7d41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f7cabf-02e0-4fe0-9922-932ccf382237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:32 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Volume a270cea7-4f42-4ed6-8396-680038747fff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a270cea7-4f42-4ed6-8396-680038747fff', 'volume_size': 1} Sep 04 15:53:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:53:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:53:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:53:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:38 devstack sudo[94263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:53:38 devstack sudo[94263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:38 devstack sudo[94263]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.298s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:38 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:53:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager._thread_info {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:53:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread count: 28 {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:53:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread info: [<_MainThread(MainThread, started 138899118923904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:53:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a2cc69e5-fcb8-4a8a-8b78-8fd7c0c746fb tempest-VolumesActionsTest-1803198185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 37.525s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a2cc69e5-fcb8-4a8a-8b78-8fd7c0c746fb tempest-VolumesActionsTest-1803198185 None] Uploaded volume to glance image-id: e738fe53-7b9a-446e-a53c-0e6073b2177c. {{(pid=87490) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 04 15:53:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.192s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-116614915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a270cea7-4f42-4ed6-8396-680038747fff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4663b8d2c23a45c6b3857ad82133ef82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:53:32Z,use_quota=True,user_id='27bca4c0c2aa4ce0920c9315587bde82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:53:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Creating volume a270cea7-4f42-4ed6-8396-680038747fff {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:53:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:53:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:53:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:53:39 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:53:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a270cea7-4f42-4ed6-8396-680038747fff 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:39 devstack sudo[94266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a270cea7-4f42-4ed6-8396-680038747fff 1073741824 Sep 04 15:53:39 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:39 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-a2cc69e5-fcb8-4a8a-8b78-8fd7c0c746fb tempest-VolumesActionsTest-1803198185 None] Copy volume to image completed successfully. Sep 04 15:53:40 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a270cea7-4f42-4ed6-8396-680038747fff 1073741824" returned: 0 in 0.424s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a270cea7-4f42-4ed6-8396-680038747fff {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:40 devstack sudo[94272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a270cea7-4f42-4ed6-8396-680038747fff Sep 04 15:53:40 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:40 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a270cea7-4f42-4ed6-8396-680038747fff" returned: 0 in 0.255s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:40 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:53:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f7cabf-02e0-4fe0-9922-932ccf382237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a270cea7-4f42-4ed6-8396-680038747fff', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (342d3cf8-e8be-4cf6-9784-30d448ae8696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:53:40 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Volume volume-a270cea7-4f42-4ed6-8396-680038747fff (a270cea7-4f42-4ed6-8396-680038747fff): created successfully Sep 04 15:53:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (342d3cf8-e8be-4cf6-9784-30d448ae8696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:53:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Flow 'volume_create_manager' (7fbb25fe-e352-496f-aa5a-4627aeb1e347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:53:40 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-b958923b-a33c-4c48-aba5-7687cc0f8667 tempest-AttachVolumeNegativeTest-1388234156 None] Created volume successfully. Sep 04 15:53:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-27b83764-5e01-4b30-b40d-4f0966b7a542 req-52bd528e-cb80-42f3-8677-03a14c564720 tempest-AttachVolumeNegativeTest-1388234156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-27b83764-5e01-4b30-b40d-4f0966b7a542 req-52bd528e-cb80-42f3-8677-03a14c564720 tempest-AttachVolumeNegativeTest-1388234156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-27b83764-5e01-4b30-b40d-4f0966b7a542 req-52bd528e-cb80-42f3-8677-03a14c564720 tempest-AttachVolumeNegativeTest-1388234156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-27b83764-5e01-4b30-b40d-4f0966b7a542 req-52bd528e-cb80-42f3-8677-03a14c564720 tempest-AttachVolumeNegativeTest-1388234156 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787', 'name': 'volume-a270cea7-4f42-4ed6-8396-680038747fff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bbd91230-baca-42d3-bf38-38c20e95d663', 'enforce_multipath': True} {{(pid=87490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:53:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3b945ed7-9bbe-4948-a26b-64aee76dd6b6 tempest-VolumesActionsTest-1803198185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3b945ed7-9bbe-4948-a26b-64aee76dd6b6 tempest-VolumesActionsTest-1803198185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:42 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-27b83764-5e01-4b30-b40d-4f0966b7a542 req-52bd528e-cb80-42f3-8677-03a14c564720 tempest-AttachVolumeNegativeTest-1388234156 None] attachment_update completed successfully. Sep 04 15:53:42 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ea3e77-89f7-4bbe-b951-35046a857fec]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3b945ed7-9bbe-4948-a26b-64aee76dd6b6 tempest-VolumesActionsTest-1803198185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:42 devstack sudo[94293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d Sep 04 15:53:42 devstack sudo[94293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:42 devstack sudo[94293]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3b945ed7-9bbe-4948-a26b-64aee76dd6b6 tempest-VolumesActionsTest-1803198185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d" returned: 0 in 0.440s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:42 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46a05c9-93be-457b-9b7f-b5ea9b98efac]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3b945ed7-9bbe-4948-a26b-64aee76dd6b6 tempest-VolumesActionsTest-1803198185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:42 devstack sudo[94681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d Sep 04 15:53:42 devstack sudo[94681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:43 devstack sudo[94681]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3b945ed7-9bbe-4948-a26b-64aee76dd6b6 tempest-VolumesActionsTest-1803198185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d" returned: 0 in 0.480s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3b945ed7-9bbe-4948-a26b-64aee76dd6b6 tempest-VolumesActionsTest-1803198185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d /opt/stack/data/cinder/conversion/7612c895-1883-4e83-b3fe-1d8bf346fb2d.temp_image.3a83f3c1-b98a-49a7-8811-cc6d5c65b6cd36zcszsq.img {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:43 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d /opt/stack/data/cinder/conversion/7612c895-1883-4e83-b3fe-1d8bf346fb2d.temp_image.3a83f3c1-b98a-49a7-8811-cc6d5c65b6cd36zcszsq.img Sep 04 15:53:43 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:47 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-82da3d86-238e-46f9-9e28-817fc7b0ec69 req-3acbf7fb-2d72-4db5-a27a-87421d6ecd3c tempest-AttachVolumeNegativeTest-1388234156 None] Terminate volume connection completed successfully. Sep 04 15:53:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-82da3d86-238e-46f9-9e28-817fc7b0ec69 req-3acbf7fb-2d72-4db5-a27a-87421d6ecd3c tempest-AttachVolumeNegativeTest-1388234156 None] Deleting attachment bbd91230-baca-42d3-bf38-38c20e95d663. {{(pid=87490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:53:49 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3b945ed7-9bbe-4948-a26b-64aee76dd6b6 tempest-VolumesActionsTest-1803198185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d /opt/stack/data/cinder/conversion/7612c895-1883-4e83-b3fe-1d8bf346fb2d.temp_image.3a83f3c1-b98a-49a7-8811-cc6d5c65b6cd36zcszsq.img" returned: 0 in 6.589s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:49 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea62480f-ce81-4d02-bfe7-3cfe0cc1411a]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3b945ed7-9bbe-4948-a26b-64aee76dd6b6 tempest-VolumesActionsTest-1803198185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:49 devstack sudo[94773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d Sep 04 15:53:49 devstack sudo[94773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:50 devstack sudo[94773]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3b945ed7-9bbe-4948-a26b-64aee76dd6b6 tempest-VolumesActionsTest-1803198185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d" returned: 0 in 1.147s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:50 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-3b945ed7-9bbe-4948-a26b-64aee76dd6b6 tempest-VolumesActionsTest-1803198185 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d, size 1024.00 MB, duration 6.59 sec, destination /opt/stack/data/cinder/conversion/7612c895-1883-4e83-b3fe-1d8bf346fb2d.temp_image.3a83f3c1-b98a-49a7-8811-cc6d5c65b6cd36zcszsq.img {{(pid=87490) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 15:53:50 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-3b945ed7-9bbe-4948-a26b-64aee76dd6b6 tempest-VolumesActionsTest-1803198185 None] Converted 1024.00 MB image at 155.38 MB/s Sep 04 15:53:50 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-3b945ed7-9bbe-4948-a26b-64aee76dd6b6 tempest-VolumesActionsTest-1803198185 None] 3a83f3c1-b98a-49a7-8811-cc6d5c65b6cd was raw, converting to qcow2 {{(pid=87490) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 04 15:53:50 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca7952f-2b43-44df-8311-6a254e25ce84]: (4, 'raw') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3b945ed7-9bbe-4948-a26b-64aee76dd6b6 tempest-VolumesActionsTest-1803198185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7612c895-1883-4e83-b3fe-1d8bf346fb2d.temp_image.3a83f3c1-b98a-49a7-8811-cc6d5c65b6cd36zcszsq.img {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:51 devstack sudo[94838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7612c895-1883-4e83-b3fe-1d8bf346fb2d.temp_image.3a83f3c1-b98a-49a7-8811-cc6d5c65b6cd36zcszsq.img Sep 04 15:53:51 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:51 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3b945ed7-9bbe-4948-a26b-64aee76dd6b6 tempest-VolumesActionsTest-1803198185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7612c895-1883-4e83-b3fe-1d8bf346fb2d.temp_image.3a83f3c1-b98a-49a7-8811-cc6d5c65b6cd36zcszsq.img" returned: 0 in 0.714s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3b945ed7-9bbe-4948-a26b-64aee76dd6b6 tempest-VolumesActionsTest-1803198185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7612c895-1883-4e83-b3fe-1d8bf346fb2d.temp_image.3a83f3c1-b98a-49a7-8811-cc6d5c65b6cd36zcszsq.img {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:51 devstack sudo[94859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7612c895-1883-4e83-b3fe-1d8bf346fb2d.temp_image.3a83f3c1-b98a-49a7-8811-cc6d5c65b6cd36zcszsq.img Sep 04 15:53:51 devstack sudo[94859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:52 devstack sudo[94859]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3b945ed7-9bbe-4948-a26b-64aee76dd6b6 tempest-VolumesActionsTest-1803198185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7612c895-1883-4e83-b3fe-1d8bf346fb2d.temp_image.3a83f3c1-b98a-49a7-8811-cc6d5c65b6cd36zcszsq.img" returned: 1 in 0.725s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3b945ed7-9bbe-4948-a26b-64aee76dd6b6 tempest-VolumesActionsTest-1803198185 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7612c895-1883-4e83-b3fe-1d8bf346fb2d.temp_image.3a83f3c1-b98a-49a7-8811-cc6d5c65b6cd36zcszsq.img' failed. Not Retrying. {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:53:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3b945ed7-9bbe-4948-a26b-64aee76dd6b6 tempest-VolumesActionsTest-1803198185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7612c895-1883-4e83-b3fe-1d8bf346fb2d.temp_image.3a83f3c1-b98a-49a7-8811-cc6d5c65b6cd36zcszsq.img /opt/stack/data/cinder/conversion/vol_upload_t8siv8od {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:52 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7612c895-1883-4e83-b3fe-1d8bf346fb2d.temp_image.3a83f3c1-b98a-49a7-8811-cc6d5c65b6cd36zcszsq.img /opt/stack/data/cinder/conversion/vol_upload_t8siv8od Sep 04 15:53:52 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:53 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3b945ed7-9bbe-4948-a26b-64aee76dd6b6 tempest-VolumesActionsTest-1803198185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7612c895-1883-4e83-b3fe-1d8bf346fb2d.temp_image.3a83f3c1-b98a-49a7-8811-cc6d5c65b6cd36zcszsq.img /opt/stack/data/cinder/conversion/vol_upload_t8siv8od" returned: 0 in 0.669s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:53 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-3b945ed7-9bbe-4948-a26b-64aee76dd6b6 tempest-VolumesActionsTest-1803198185 None] Image conversion details: src /opt/stack/data/cinder/conversion/7612c895-1883-4e83-b3fe-1d8bf346fb2d.temp_image.3a83f3c1-b98a-49a7-8811-cc6d5c65b6cd36zcszsq.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_t8siv8od {{(pid=87490) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 15:53:53 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-3b945ed7-9bbe-4948-a26b-64aee76dd6b6 tempest-VolumesActionsTest-1803198185 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 04 15:53:53 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9c8c5a-ff3f-4969-9f80-2cacacc75ebb]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3b945ed7-9bbe-4948-a26b-64aee76dd6b6 tempest-VolumesActionsTest-1803198185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_t8siv8od {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:53 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_t8siv8od Sep 04 15:53:53 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:53 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3b945ed7-9bbe-4948-a26b-64aee76dd6b6 tempest-VolumesActionsTest-1803198185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_t8siv8od" returned: 0 in 0.667s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3b945ed7-9bbe-4948-a26b-64aee76dd6b6 tempest-VolumesActionsTest-1803198185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.345s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:56 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3b945ed7-9bbe-4948-a26b-64aee76dd6b6 tempest-VolumesActionsTest-1803198185 None] Uploaded volume to glance image-id: 3a83f3c1-b98a-49a7-8811-cc6d5c65b6cd. {{(pid=87490) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 04 15:53:56 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-3b945ed7-9bbe-4948-a26b-64aee76dd6b6 tempest-VolumesActionsTest-1803198185 None] Copy volume to image completed successfully. Sep 04 15:53:58 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-26c5fac3-c383-429c-a2ad-1b5e1ff131e2 tempest-VolumesActionsTest-1803198185 None] Acquiring lock "cinder-7612c895-1883-4e83-b3fe-1d8bf346fb2d-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:58 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-26c5fac3-c383-429c-a2ad-1b5e1ff131e2 tempest-VolumesActionsTest-1803198185 None] Lock "cinder-7612c895-1883-4e83-b3fe-1d8bf346fb2d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:58 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-26c5fac3-c383-429c-a2ad-1b5e1ff131e2 tempest-VolumesActionsTest-1803198185 None] Acquiring lock "cinder-quobyte-7612c895-1883-4e83-b3fe-1d8bf346fb2d" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:53:58 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-26c5fac3-c383-429c-a2ad-1b5e1ff131e2 tempest-VolumesActionsTest-1803198185 None] Lock "cinder-quobyte-7612c895-1883-4e83-b3fe-1d8bf346fb2d" acquired by "delete_volume" :: waited 0.027s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:53:58 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a30b76c-2b90-4362-949c-43fb1e794c6c]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:53:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-26c5fac3-c383-429c-a2ad-1b5e1ff131e2 tempest-VolumesActionsTest-1803198185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:58 devstack sudo[94894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d Sep 04 15:53:58 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:58 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-26c5fac3-c383-429c-a2ad-1b5e1ff131e2 tempest-VolumesActionsTest-1803198185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d" returned: 0 in 0.546s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-26c5fac3-c383-429c-a2ad-1b5e1ff131e2 tempest-VolumesActionsTest-1803198185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:59 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d Sep 04 15:53:59 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:59 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-26c5fac3-c383-429c-a2ad-1b5e1ff131e2 tempest-VolumesActionsTest-1803198185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7612c895-1883-4e83-b3fe-1d8bf346fb2d" returned: 0 in 0.323s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:59 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-26c5fac3-c383-429c-a2ad-1b5e1ff131e2 tempest-VolumesActionsTest-1803198185 None] Lock "cinder-quobyte-7612c895-1883-4e83-b3fe-1d8bf346fb2d" released by "delete_volume" :: held 0.927s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:53:59 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-26c5fac3-c383-429c-a2ad-1b5e1ff131e2 tempest-VolumesActionsTest-1803198185 None] Created reservations ['cdbf5f5e-88cb-46bd-bf45-b66c8e1ade9e', '523b0fe6-33aa-4aa0-b030-4a476ad8664f', '52e92dd9-95ce-4595-b6fa-1e52cc8f10df', '88aa59ee-af31-4b9f-8a6e-d551fdd5ec5e'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:53:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-26c5fac3-c383-429c-a2ad-1b5e1ff131e2 tempest-VolumesActionsTest-1803198185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:53:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-26c5fac3-c383-429c-a2ad-1b5e1ff131e2 tempest-VolumesActionsTest-1803198185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:53:59 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-26c5fac3-c383-429c-a2ad-1b5e1ff131e2 tempest-VolumesActionsTest-1803198185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:53:59 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-26c5fac3-c383-429c-a2ad-1b5e1ff131e2 tempest-VolumesActionsTest-1803198185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:53:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-26c5fac3-c383-429c-a2ad-1b5e1ff131e2 tempest-VolumesActionsTest-1803198185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:53:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-26c5fac3-c383-429c-a2ad-1b5e1ff131e2 tempest-VolumesActionsTest-1803198185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:53:59 devstack sudo[94904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:53:59 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:53:59 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root Sep 04 15:53:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-26c5fac3-c383-429c-a2ad-1b5e1ff131e2 tempest-VolumesActionsTest-1803198185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.322s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:53:59 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-26c5fac3-c383-429c-a2ad-1b5e1ff131e2 tempest-VolumesActionsTest-1803198185 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:53:59 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-26c5fac3-c383-429c-a2ad-1b5e1ff131e2 tempest-VolumesActionsTest-1803198185 None] Deleted volume successfully. Sep 04 15:53:59 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-26c5fac3-c383-429c-a2ad-1b5e1ff131e2 tempest-VolumesActionsTest-1803198185 None] Lock "cinder-7612c895-1883-4e83-b3fe-1d8bf346fb2d-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:09 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:UPDATE=10,cinder:SELECT=18,cinder:INSERT=4 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:54:09 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=16,cinder:UPDATE=17,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:54:12 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:54:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Flow 'volume_create_manager' (a7a66a36-adad-4970-9770-f8d4d6aac6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad31bf9-e393-4899-942a-712fce87dcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad31bf9-e393-4899-942a-712fce87dcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2070390824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c96165cf-d4ea-46f4-8b8d-b7154faff0e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e01f5abc82b4e7ba176df540b0a6794',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:12Z,use_quota=True,user_id='9b5ad4434d4541a3bf5946cdd8d490c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77fa3148-d4ab-488e-b579-9dca2d276c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77fa3148-d4ab-488e-b579-9dca2d276c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (424a40ae-3043-4914-89c5-a50c2328d09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (424a40ae-3043-4914-89c5-a50c2328d09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c96165cf-d4ea-46f4-8b8d-b7154faff0e0', 'volume_name': 'volume-c96165cf-d4ea-46f4-8b8d-b7154faff0e0', 'volume_size': 2}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b31490-4a73-4e67-9511-3b06be496d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b31490-4a73-4e67-9511-3b06be496d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32580dad-7eb9-467d-a133-b9836068d12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:12 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Volume c96165cf-d4ea-46f4-8b8d-b7154faff0e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c96165cf-d4ea-46f4-8b8d-b7154faff0e0', 'volume_size': 2} Sep 04 15:54:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2070390824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c96165cf-d4ea-46f4-8b8d-b7154faff0e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e01f5abc82b4e7ba176df540b0a6794',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:12Z,use_quota=True,user_id='9b5ad4434d4541a3bf5946cdd8d490c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:54:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Creating volume c96165cf-d4ea-46f4-8b8d-b7154faff0e0 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:54:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:54:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:54:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:54:12 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:54:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c96165cf-d4ea-46f4-8b8d-b7154faff0e0 2147483648 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:12 devstack sudo[95118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c96165cf-d4ea-46f4-8b8d-b7154faff0e0 2147483648 Sep 04 15:54:12 devstack sudo[95118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:13 devstack sudo[95118]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c96165cf-d4ea-46f4-8b8d-b7154faff0e0 2147483648" returned: 0 in 1.411s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c96165cf-d4ea-46f4-8b8d-b7154faff0e0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:14 devstack sudo[95134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c96165cf-d4ea-46f4-8b8d-b7154faff0e0 Sep 04 15:54:14 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:14 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c96165cf-d4ea-46f4-8b8d-b7154faff0e0" returned: 0 in 0.435s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] <== create_volume: return (1965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:54:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.968s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32580dad-7eb9-467d-a133-b9836068d12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c96165cf-d4ea-46f4-8b8d-b7154faff0e0', 'volume_size': 2}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a917d0e-4cb0-4584-9b72-558ee3af2d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:14 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Volume volume-c96165cf-d4ea-46f4-8b8d-b7154faff0e0 (c96165cf-d4ea-46f4-8b8d-b7154faff0e0): created successfully Sep 04 15:54:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a917d0e-4cb0-4584-9b72-558ee3af2d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Flow 'volume_create_manager' (a7a66a36-adad-4970-9770-f8d4d6aac6a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:14 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-0bcbb234-a0f3-494d-ab56-0085c8d9a93c tempest-VolumesCloneNegativeTest-697686673 None] Created volume successfully. Sep 04 15:54:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5c633de3-bd2a-4b45-8d96-f91eaf770422 tempest-VolumesCloneNegativeTest-697686673 None] Acquiring lock "cinder-c96165cf-d4ea-46f4-8b8d-b7154faff0e0-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5c633de3-bd2a-4b45-8d96-f91eaf770422 tempest-VolumesCloneNegativeTest-697686673 None] Lock "cinder-c96165cf-d4ea-46f4-8b8d-b7154faff0e0-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5c633de3-bd2a-4b45-8d96-f91eaf770422 tempest-VolumesCloneNegativeTest-697686673 None] Acquiring lock "cinder-quobyte-c96165cf-d4ea-46f4-8b8d-b7154faff0e0" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5c633de3-bd2a-4b45-8d96-f91eaf770422 tempest-VolumesCloneNegativeTest-697686673 None] Lock "cinder-quobyte-c96165cf-d4ea-46f4-8b8d-b7154faff0e0" acquired by "delete_volume" :: waited 0.041s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:16 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[a862cbf3-c337-4bf2-b52c-dfca3090d3ec]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5c633de3-bd2a-4b45-8d96-f91eaf770422 tempest-VolumesCloneNegativeTest-697686673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c96165cf-d4ea-46f4-8b8d-b7154faff0e0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:16 devstack sudo[95140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c96165cf-d4ea-46f4-8b8d-b7154faff0e0 Sep 04 15:54:16 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:17 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5c633de3-bd2a-4b45-8d96-f91eaf770422 tempest-VolumesCloneNegativeTest-697686673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c96165cf-d4ea-46f4-8b8d-b7154faff0e0" returned: 0 in 0.941s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5c633de3-bd2a-4b45-8d96-f91eaf770422 tempest-VolumesCloneNegativeTest-697686673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c96165cf-d4ea-46f4-8b8d-b7154faff0e0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:17 devstack sudo[95146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c96165cf-d4ea-46f4-8b8d-b7154faff0e0 Sep 04 15:54:17 devstack sudo[95146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:17 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:54:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Flow 'volume_create_manager' (e4124123-6d52-4718-97ee-e0ae47683618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee7236b-13cb-492f-b7e2-1a7a25e5273d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee7236b-13cb-492f-b7e2-1a7a25e5273d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1328737857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e54da6-16be-4004-8d4f-35dc6a54ec2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a5ff7f5c7c94295aa30204d02b743c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:17Z,use_quota=True,user_id='d152be2378ee4eb89ba1858992960f42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee8cffe-7402-455d-b393-1bdba5eb5ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee8cffe-7402-455d-b393-1bdba5eb5ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4405eb15-6c96-4a1e-a8c6-a421d4ca1334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4405eb15-6c96-4a1e-a8c6-a421d4ca1334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23e54da6-16be-4004-8d4f-35dc6a54ec2b', 'volume_name': 'volume-23e54da6-16be-4004-8d4f-35dc6a54ec2b', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe22770-f27e-4db2-b287-2a85eb8412c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe22770-f27e-4db2-b287-2a85eb8412c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2d2300-dea3-40cd-8a62-1e4435ea4c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:17 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Volume 23e54da6-16be-4004-8d4f-35dc6a54ec2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23e54da6-16be-4004-8d4f-35dc6a54ec2b', 'volume_size': 1} Sep 04 15:54:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:17 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1328737857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e54da6-16be-4004-8d4f-35dc6a54ec2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a5ff7f5c7c94295aa30204d02b743c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:17Z,use_quota=True,user_id='d152be2378ee4eb89ba1858992960f42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:54:17 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Creating volume 23e54da6-16be-4004-8d4f-35dc6a54ec2b {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:54:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:17 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:54:17 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:54:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:17 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:54:17 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:54:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-23e54da6-16be-4004-8d4f-35dc6a54ec2b 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:17 devstack sudo[95149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-23e54da6-16be-4004-8d4f-35dc6a54ec2b 1073741824 Sep 04 15:54:17 devstack sudo[95149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:17 devstack sudo[95146]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5c633de3-bd2a-4b45-8d96-f91eaf770422 tempest-VolumesCloneNegativeTest-697686673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c96165cf-d4ea-46f4-8b8d-b7154faff0e0" returned: 0 in 0.629s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:17 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5c633de3-bd2a-4b45-8d96-f91eaf770422 tempest-VolumesCloneNegativeTest-697686673 None] Lock "cinder-quobyte-c96165cf-d4ea-46f4-8b8d-b7154faff0e0" released by "delete_volume" :: held 1.667s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:18 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-5c633de3-bd2a-4b45-8d96-f91eaf770422 tempest-VolumesCloneNegativeTest-697686673 None] Created reservations ['3df4ae37-5c5e-4a21-ba73-3ef72426c560', '0dba9794-372d-4f3a-b2ef-197f7ecf503c', 'a0686490-b981-4f3e-8c51-24374b372191', 'f7d59ad1-9cf6-4180-87e7-3b0c3d496d3c'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:54:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5c633de3-bd2a-4b45-8d96-f91eaf770422 tempest-VolumesCloneNegativeTest-697686673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5c633de3-bd2a-4b45-8d96-f91eaf770422 tempest-VolumesCloneNegativeTest-697686673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-5c633de3-bd2a-4b45-8d96-f91eaf770422 tempest-VolumesCloneNegativeTest-697686673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:54:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-5c633de3-bd2a-4b45-8d96-f91eaf770422 tempest-VolumesCloneNegativeTest-697686673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:54:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5c633de3-bd2a-4b45-8d96-f91eaf770422 tempest-VolumesCloneNegativeTest-697686673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5c633de3-bd2a-4b45-8d96-f91eaf770422 tempest-VolumesCloneNegativeTest-697686673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:18 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:54:18 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:18 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5c633de3-bd2a-4b45-8d96-f91eaf770422 tempest-VolumesCloneNegativeTest-697686673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.355s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:18 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-5c633de3-bd2a-4b45-8d96-f91eaf770422 tempest-VolumesCloneNegativeTest-697686673 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:54:18 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-5c633de3-bd2a-4b45-8d96-f91eaf770422 tempest-VolumesCloneNegativeTest-697686673 None] Deleted volume successfully. Sep 04 15:54:18 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5c633de3-bd2a-4b45-8d96-f91eaf770422 tempest-VolumesCloneNegativeTest-697686673 None] Lock "cinder-c96165cf-d4ea-46f4-8b8d-b7154faff0e0-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:18 devstack sudo[95149]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-23e54da6-16be-4004-8d4f-35dc6a54ec2b 1073741824" returned: 0 in 0.954s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-23e54da6-16be-4004-8d4f-35dc6a54ec2b {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:18 devstack sudo[95161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-23e54da6-16be-4004-8d4f-35dc6a54ec2b Sep 04 15:54:18 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:18 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-23e54da6-16be-4004-8d4f-35dc6a54ec2b" returned: 0 in 0.295s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:54:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2d2300-dea3-40cd-8a62-1e4435ea4c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23e54da6-16be-4004-8d4f-35dc6a54ec2b', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c53d968a-6f43-4243-a637-36fa58483de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:18 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Volume volume-23e54da6-16be-4004-8d4f-35dc6a54ec2b (23e54da6-16be-4004-8d4f-35dc6a54ec2b): created successfully Sep 04 15:54:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c53d968a-6f43-4243-a637-36fa58483de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Flow 'volume_create_manager' (e4124123-6d52-4718-97ee-e0ae47683618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:19 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-d7abb02f-bc29-42db-9568-c143442a556a tempest-AttachVolumeShelveTestJSON-2071262142 None] Created volume successfully. Sep 04 15:54:29 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=11,cinder:INSERT=3,cinder:UPDATE=13,cinder:DELETE=2 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:54:29 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:UPDATE=15,cinder:SELECT=7,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:54:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-34bda62b-15bc-476a-b40e-02f93d5f738a req-35647afd-d1bc-434a-94b1-26accd6259e0 tempest-AttachVolumeShelveTestJSON-2071262142 None] No connector for attachment 26f06b20-2e3d-47f8-ab76-cba17674d28d; skipping storage backend terminate_connection call. {{(pid=87490) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 04 15:54:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-34bda62b-15bc-476a-b40e-02f93d5f738a req-35647afd-d1bc-434a-94b1-26accd6259e0 tempest-AttachVolumeShelveTestJSON-2071262142 None] Deleting attachment 26f06b20-2e3d-47f8-ab76-cba17674d28d. {{(pid=87490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:54:34 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:54:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Flow 'volume_create_manager' (31f657fb-4f05-4c90-9f90-ae330603837a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6e9270-6b67-4e0d-8617-da0e1cbae8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6e9270-6b67-4e0d-8617-da0e1cbae8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-725196329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3738d859-c36e-49f1-9857-803a9f87461c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce80b069786744fc84a213f235dfcf2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:34Z,use_quota=True,user_id='6c2de99b275f46bd9cd7dda83f69c299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d7d821-51f7-4dc9-ba04-ddde97a7205c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d7d821-51f7-4dc9-ba04-ddde97a7205c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb16fc6d-15a8-49a0-b9ed-67c691839f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb16fc6d-15a8-49a0-b9ed-67c691839f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3738d859-c36e-49f1-9857-803a9f87461c', 'volume_name': 'volume-3738d859-c36e-49f1-9857-803a9f87461c', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a24a50-a0c6-491d-a332-8a6d9ca33860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a24a50-a0c6-491d-a332-8a6d9ca33860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b72008-7bea-49cb-9a66-f944a11bd342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:34 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Volume 3738d859-c36e-49f1-9857-803a9f87461c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3738d859-c36e-49f1-9857-803a9f87461c', 'volume_size': 1} Sep 04 15:54:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-725196329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3738d859-c36e-49f1-9857-803a9f87461c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce80b069786744fc84a213f235dfcf2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:34Z,use_quota=True,user_id='6c2de99b275f46bd9cd7dda83f69c299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:54:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Creating volume 3738d859-c36e-49f1-9857-803a9f87461c {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:54:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:54:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:54:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:54:34 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:54:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3738d859-c36e-49f1-9857-803a9f87461c 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:34 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3738d859-c36e-49f1-9857-803a9f87461c 1073741824 Sep 04 15:54:34 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:34 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3738d859-c36e-49f1-9857-803a9f87461c 1073741824" returned: 0 in 0.554s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3738d859-c36e-49f1-9857-803a9f87461c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:35 devstack sudo[95323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3738d859-c36e-49f1-9857-803a9f87461c Sep 04 15:54:35 devstack sudo[95323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:35 devstack sudo[95323]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3738d859-c36e-49f1-9857-803a9f87461c" returned: 0 in 0.269s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:54:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b72008-7bea-49cb-9a66-f944a11bd342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3738d859-c36e-49f1-9857-803a9f87461c', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2633841f-2801-44e1-9c4a-04a9615efc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:35 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Volume volume-3738d859-c36e-49f1-9857-803a9f87461c (3738d859-c36e-49f1-9857-803a9f87461c): created successfully Sep 04 15:54:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2633841f-2801-44e1-9c4a-04a9615efc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Flow 'volume_create_manager' (31f657fb-4f05-4c90-9f90-ae330603837a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:35 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-5aad111e-ef4d-4519-a0cc-3d1aef3059bc tempest-AttachVolumeTestJSON-680909899 None] Created volume successfully. Sep 04 15:54:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-2a497a1a-0069-41d4-8133-28aba8a7d092 req-24d598ed-ac01-4781-8293-05518a738f40 tempest-AttachVolumeTestJSON-680909899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-2a497a1a-0069-41d4-8133-28aba8a7d092 req-24d598ed-ac01-4781-8293-05518a738f40 tempest-AttachVolumeTestJSON-680909899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-2a497a1a-0069-41d4-8133-28aba8a7d092 req-24d598ed-ac01-4781-8293-05518a738f40 tempest-AttachVolumeTestJSON-680909899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-2a497a1a-0069-41d4-8133-28aba8a7d092 req-24d598ed-ac01-4781-8293-05518a738f40 tempest-AttachVolumeTestJSON-680909899 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787', 'name': 'volume-3738d859-c36e-49f1-9857-803a9f87461c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '72cd0d3b-9d37-4a17-9d96-b794c1e58fdf', 'enforce_multipath': True} {{(pid=87490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:54:38 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-2a497a1a-0069-41d4-8133-28aba8a7d092 req-24d598ed-ac01-4781-8293-05518a738f40 tempest-AttachVolumeTestJSON-680909899 None] attachment_update completed successfully. Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Flow 'volume_create_manager' (e34169a4-9768-4c12-97d1-27d9acdb8299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6571cc-6cf5-4960-b8d2-50d39a72123d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6571cc-6cf5-4960-b8d2-50d39a72123d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1540009394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36768858-4b89-4cab-83cd-1d819b7ae985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4663b8d2c23a45c6b3857ad82133ef82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:38Z,use_quota=True,user_id='27bca4c0c2aa4ce0920c9315587bde82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc8caba-b3c1-446a-9522-a05ebad5b1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc8caba-b3c1-446a-9522-a05ebad5b1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d85b1f-b735-4815-8f51-dbea934db390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d85b1f-b735-4815-8f51-dbea934db390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36768858-4b89-4cab-83cd-1d819b7ae985', 'volume_name': 'volume-36768858-4b89-4cab-83cd-1d819b7ae985', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d60e169-895d-4f33-bbc8-813b604ff382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d60e169-895d-4f33-bbc8-813b604ff382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac64b0a1-a69a-43b9-be68-598876296e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:38 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Volume 36768858-4b89-4cab-83cd-1d819b7ae985: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36768858-4b89-4cab-83cd-1d819b7ae985', 'volume_size': 1} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1540009394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36768858-4b89-4cab-83cd-1d819b7ae985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4663b8d2c23a45c6b3857ad82133ef82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:38Z,use_quota=True,user_id='27bca4c0c2aa4ce0920c9315587bde82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Creating volume 36768858-4b89-4cab-83cd-1d819b7ae985 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:54:38 devstack sudo[95342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:54:38 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:54:38 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-36768858-4b89-4cab-83cd-1d819b7ae985 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:38 devstack sudo[95365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-36768858-4b89-4cab-83cd-1d819b7ae985 1073741824 Sep 04 15:54:38 devstack sudo[95365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Flow 'volume_create_manager' (44a19f43-e327-4425-bd00-b52bc1e5a54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b4426bd-1cd4-4500-bfe9-7f4fc468b180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b4426bd-1cd4-4500-bfe9-7f4fc468b180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1775425667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f04fa9a-acbd-4e21-9cd4-afd8627803cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac98e88b2484d91b26976d2b4e1fd6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:38Z,use_quota=True,user_id='af7b045b02a84c069b6bb5877f41bbfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3fb7dec-4dd1-42d7-b342-fd2e51257c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3fb7dec-4dd1-42d7-b342-fd2e51257c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f267a5-9541-4517-a1b5-0321d8a0a09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f267a5-9541-4517-a1b5-0321d8a0a09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f04fa9a-acbd-4e21-9cd4-afd8627803cf', 'volume_name': 'volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0381aa3a-258a-4ea6-b6f6-4e54603fe044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0381aa3a-258a-4ea6-b6f6-4e54603fe044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180d35fd-b210-4ca9-ba77-eadc0fcfe1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:38 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Volume 5f04fa9a-acbd-4e21-9cd4-afd8627803cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf', 'volume_size': 1} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:38 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.598s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager._thread_info {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread count: 28 {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:54:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread info: [<_MainThread(MainThread, started 138899118923904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:54:39 devstack sudo[95365]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-36768858-4b89-4cab-83cd-1d819b7ae985 1073741824" returned: 0 in 0.784s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-36768858-4b89-4cab-83cd-1d819b7ae985 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:39 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-36768858-4b89-4cab-83cd-1d819b7ae985 Sep 04 15:54:39 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:39 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-36768858-4b89-4cab-83cd-1d819b7ae985" returned: 0 in 0.292s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:54:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.651s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1775425667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f04fa9a-acbd-4e21-9cd4-afd8627803cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac98e88b2484d91b26976d2b4e1fd6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:38Z,use_quota=True,user_id='af7b045b02a84c069b6bb5877f41bbfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:54:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Creating volume 5f04fa9a-acbd-4e21-9cd4-afd8627803cf {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:54:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:54:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:54:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:54:39 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:54:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:39 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf 1073741824 Sep 04 15:54:39 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac64b0a1-a69a-43b9-be68-598876296e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36768858-4b89-4cab-83cd-1d819b7ae985', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9aa9b0d-881b-435e-9f80-ba602c29438c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:39 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Volume volume-36768858-4b89-4cab-83cd-1d819b7ae985 (36768858-4b89-4cab-83cd-1d819b7ae985): created successfully Sep 04 15:54:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9aa9b0d-881b-435e-9f80-ba602c29438c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Flow 'volume_create_manager' (e34169a4-9768-4c12-97d1-27d9acdb8299) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:39 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-eab22913-47e7-49b9-be80-0e9988ddb2fd tempest-AttachVolumeNegativeTest-1388234156 None] Created volume successfully. Sep 04 15:54:39 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf 1073741824" returned: 0 in 0.503s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:39 devstack sudo[95757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf Sep 04 15:54:39 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:40 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf" returned: 0 in 0.284s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180d35fd-b210-4ca9-ba77-eadc0fcfe1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f267beeb-f961-4522-9178-1f290b8fc124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:40 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Volume volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf (5f04fa9a-acbd-4e21-9cd4-afd8627803cf): created successfully Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f267beeb-f961-4522-9178-1f290b8fc124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Flow 'volume_create_manager' (44a19f43-e327-4425-bd00-b52bc1e5a54c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:40 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-95c75e05-9f21-40de-bb96-cb2fe193cf97 tempest-VolumesSnapshotTestJSON-1655945923 None] Created volume successfully. Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Flow 'volume_create_manager' (03817a88-a5e1-4993-838e-8130c6930490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e5d6c2-9014-49b4-addc-e050d41ac872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e5d6c2-9014-49b4-addc-e050d41ac872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-540916543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6bd8421-f7a5-4bed-b2c7-b66c1d85720c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce80b069786744fc84a213f235dfcf2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:40Z,use_quota=True,user_id='6c2de99b275f46bd9cd7dda83f69c299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5faee718-9614-490c-845c-ed934422e53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5faee718-9614-490c-845c-ed934422e53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb12d030-dc60-42f6-9a04-7acabc29b0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb12d030-dc60-42f6-9a04-7acabc29b0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6bd8421-f7a5-4bed-b2c7-b66c1d85720c', 'volume_name': 'volume-d6bd8421-f7a5-4bed-b2c7-b66c1d85720c', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c47b557-e3bb-46a3-b473-30b2170f04fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c47b557-e3bb-46a3-b473-30b2170f04fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562f06b8-2e1d-4cc8-9aef-d0a2b76798b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:40 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Volume d6bd8421-f7a5-4bed-b2c7-b66c1d85720c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6bd8421-f7a5-4bed-b2c7-b66c1d85720c', 'volume_size': 1} Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-540916543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6bd8421-f7a5-4bed-b2c7-b66c1d85720c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce80b069786744fc84a213f235dfcf2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:40Z,use_quota=True,user_id='6c2de99b275f46bd9cd7dda83f69c299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Creating volume d6bd8421-f7a5-4bed-b2c7-b66c1d85720c {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:54:40 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:54:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d6bd8421-f7a5-4bed-b2c7-b66c1d85720c 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:40 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d6bd8421-f7a5-4bed-b2c7-b66c1d85720c 1073741824 Sep 04 15:54:40 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-23754f66-4ecd-4abb-967d-43c60bd2fb50 tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:41 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d6bd8421-f7a5-4bed-b2c7-b66c1d85720c 1073741824" returned: 0 in 0.616s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d6bd8421-f7a5-4bed-b2c7-b66c1d85720c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:41 devstack sudo[95795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d6bd8421-f7a5-4bed-b2c7-b66c1d85720c Sep 04 15:54:41 devstack sudo[95795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-e4c25b56-c690-451b-b664-3892fbcdc866 req-6e216e97-9a73-433b-af68-a8a268bbdb09 tempest-AttachVolumeNegativeTest-1388234156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:41 devstack sudo[95795]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d6bd8421-f7a5-4bed-b2c7-b66c1d85720c" returned: 0 in 0.347s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:41 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:54:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-23754f66-4ecd-4abb-967d-43c60bd2fb50 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.541s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562f06b8-2e1d-4cc8-9aef-d0a2b76798b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6bd8421-f7a5-4bed-b2c7-b66c1d85720c', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b16d11d-5551-4a67-8018-15f73c3e1556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:41 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-23754f66-4ecd-4abb-967d-43c60bd2fb50 tempest-VolumesSnapshotTestJSON-1655945923 None] Creating offline snapshot 28c024cb-fee2-44ef-a224-a74838ecb98d of volume 5f04fa9a-acbd-4e21-9cd4-afd8627803cf {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:54:41 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Volume volume-d6bd8421-f7a5-4bed-b2c7-b66c1d85720c (d6bd8421-f7a5-4bed-b2c7-b66c1d85720c): created successfully Sep 04 15:54:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b16d11d-5551-4a67-8018-15f73c3e1556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Flow 'volume_create_manager' (03817a88-a5e1-4993-838e-8130c6930490) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:41 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[5455f414-7a97-4480-8a96-4fb970491a79]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23754f66-4ecd-4abb-967d-43c60bd2fb50 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:41 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-c5f13043-1ea4-4d2d-86fa-eca159e205da tempest-AttachVolumeTestJSON-680909899 None] Created volume successfully. Sep 04 15:54:41 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf Sep 04 15:54:41 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:42 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23754f66-4ecd-4abb-967d-43c60bd2fb50 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf" returned: 0 in 0.364s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23754f66-4ecd-4abb-967d-43c60bd2fb50 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf.28c024cb-fee2-44ef-a224-a74838ecb98d 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:42 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf.28c024cb-fee2-44ef-a224-a74838ecb98d 1G Sep 04 15:54:42 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:42 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23754f66-4ecd-4abb-967d-43c60bd2fb50 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf.28c024cb-fee2-44ef-a224-a74838ecb98d 1G" returned: 0 in 0.718s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23754f66-4ecd-4abb-967d-43c60bd2fb50 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf.28c024cb-fee2-44ef-a224-a74838ecb98d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:42 devstack sudo[95865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf.28c024cb-fee2-44ef-a224-a74838ecb98d Sep 04 15:54:42 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:43 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23754f66-4ecd-4abb-967d-43c60bd2fb50 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf.28c024cb-fee2-44ef-a224-a74838ecb98d" returned: 0 in 0.596s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:43 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-23754f66-4ecd-4abb-967d-43c60bd2fb50 tempest-VolumesSnapshotTestJSON-1655945923 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf.28c024cb-fee2-44ef-a224-a74838ecb98d is being set with open permissions: ugo+rw Sep 04 15:54:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23754f66-4ecd-4abb-967d-43c60bd2fb50 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf.28c024cb-fee2-44ef-a224-a74838ecb98d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:43 devstack sudo[95885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf.28c024cb-fee2-44ef-a224-a74838ecb98d Sep 04 15:54:43 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:43 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23754f66-4ecd-4abb-967d-43c60bd2fb50 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf.28c024cb-fee2-44ef-a224-a74838ecb98d" returned: 0 in 0.319s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23754f66-4ecd-4abb-967d-43c60bd2fb50 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-f23dcfd2-b3f9-4582-be61-0c38de5d9e74 req-b2de6774-88b6-4ea4-afd6-b8ccc7177965 tempest-AttachVolumeTestJSON-680909899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:43 devstack sudo[95896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf.info Sep 04 15:54:43 devstack sudo[95896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:44 devstack sudo[95896]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23754f66-4ecd-4abb-967d-43c60bd2fb50 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf.info" returned: 0 in 0.309s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:44 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-23754f66-4ecd-4abb-967d-43c60bd2fb50 tempest-VolumesSnapshotTestJSON-1655945923 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf.info is being set with open permissions: ugo+rw Sep 04 15:54:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23754f66-4ecd-4abb-967d-43c60bd2fb50 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:44 devstack sudo[95901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf.info Sep 04 15:54:44 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:44 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23754f66-4ecd-4abb-967d-43c60bd2fb50 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf.info" returned: 0 in 0.253s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-23754f66-4ecd-4abb-967d-43c60bd2fb50 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.698s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-e4c25b56-c690-451b-b664-3892fbcdc866 req-6e216e97-9a73-433b-af68-a8a268bbdb09 tempest-AttachVolumeNegativeTest-1388234156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.877s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-e4c25b56-c690-451b-b664-3892fbcdc866 req-6e216e97-9a73-433b-af68-a8a268bbdb09 tempest-AttachVolumeNegativeTest-1388234156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-f23dcfd2-b3f9-4582-be61-0c38de5d9e74 req-b2de6774-88b6-4ea4-afd6-b8ccc7177965 tempest-AttachVolumeTestJSON-680909899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.597s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-f23dcfd2-b3f9-4582-be61-0c38de5d9e74 req-b2de6774-88b6-4ea4-afd6-b8ccc7177965 tempest-AttachVolumeTestJSON-680909899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.108s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-e4c25b56-c690-451b-b664-3892fbcdc866 req-6e216e97-9a73-433b-af68-a8a268bbdb09 tempest-AttachVolumeNegativeTest-1388234156 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787', 'name': 'volume-36768858-4b89-4cab-83cd-1d819b7ae985', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca5a0077-b938-4a98-be59-054594b82df5', 'enforce_multipath': True} {{(pid=87490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:54:44 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-23754f66-4ecd-4abb-967d-43c60bd2fb50 tempest-VolumesSnapshotTestJSON-1655945923 None] Create snapshot completed successfully Sep 04 15:54:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-f23dcfd2-b3f9-4582-be61-0c38de5d9e74 req-b2de6774-88b6-4ea4-afd6-b8ccc7177965 tempest-AttachVolumeTestJSON-680909899 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787', 'name': 'volume-d6bd8421-f7a5-4bed-b2c7-b66c1d85720c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e0cab427-3689-424a-b015-be8f9e7ba618', 'enforce_multipath': True} {{(pid=87490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:54:44 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-e4c25b56-c690-451b-b664-3892fbcdc866 req-6e216e97-9a73-433b-af68-a8a268bbdb09 tempest-AttachVolumeNegativeTest-1388234156 None] attachment_update completed successfully. Sep 04 15:54:44 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-f23dcfd2-b3f9-4582-be61-0c38de5d9e74 req-b2de6774-88b6-4ea4-afd6-b8ccc7177965 tempest-AttachVolumeTestJSON-680909899 None] attachment_update completed successfully. Sep 04 15:54:45 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c4ee78c5-707a-4bc1-9313-b7ab8dddb9a6 tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "cinder-28c024cb-fee2-44ef-a224-a74838ecb98d-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:45 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c4ee78c5-707a-4bc1-9313-b7ab8dddb9a6 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-28c024cb-fee2-44ef-a224-a74838ecb98d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:45 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c4ee78c5-707a-4bc1-9313-b7ab8dddb9a6 tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "cinder-quobyte-5f04fa9a-acbd-4e21-9cd4-afd8627803cf" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:45 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c4ee78c5-707a-4bc1-9313-b7ab8dddb9a6 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-5f04fa9a-acbd-4e21-9cd4-afd8627803cf" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:45 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c4ee78c5-707a-4bc1-9313-b7ab8dddb9a6 tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "cinder-quobyte-28c024cb-fee2-44ef-a224-a74838ecb98d" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:45 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c4ee78c5-707a-4bc1-9313-b7ab8dddb9a6 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-28c024cb-fee2-44ef-a224-a74838ecb98d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-c4ee78c5-707a-4bc1-9313-b7ab8dddb9a6 tempest-VolumesSnapshotTestJSON-1655945923 None] Deleting offline snapshot 28c024cb-fee2-44ef-a224-a74838ecb98d of volume 5f04fa9a-acbd-4e21-9cd4-afd8627803cf {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:54:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-c4ee78c5-707a-4bc1-9313-b7ab8dddb9a6 tempest-VolumesSnapshotTestJSON-1655945923 None] snapshot_file for this snap is: volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf.28c024cb-fee2-44ef-a224-a74838ecb98d {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:54:45 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[8565f1f6-4bf2-4791-8881-e4b49b39f52d]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c4ee78c5-707a-4bc1-9313-b7ab8dddb9a6 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf.28c024cb-fee2-44ef-a224-a74838ecb98d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:45 devstack sudo[95909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf.28c024cb-fee2-44ef-a224-a74838ecb98d Sep 04 15:54:45 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:45 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c4ee78c5-707a-4bc1-9313-b7ab8dddb9a6 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf.28c024cb-fee2-44ef-a224-a74838ecb98d" returned: 0 in 0.459s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-c4ee78c5-707a-4bc1-9313-b7ab8dddb9a6 tempest-VolumesSnapshotTestJSON-1655945923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:54:45 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[283bb815-92fa-4a5c-bef3-b379d94be850]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c4ee78c5-707a-4bc1-9313-b7ab8dddb9a6 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:45 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf Sep 04 15:54:45 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:46 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c4ee78c5-707a-4bc1-9313-b7ab8dddb9a6 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf" returned: 0 in 0.447s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c4ee78c5-707a-4bc1-9313-b7ab8dddb9a6 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf.28c024cb-fee2-44ef-a224-a74838ecb98d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:46 devstack sudo[95928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf.28c024cb-fee2-44ef-a224-a74838ecb98d Sep 04 15:54:46 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:46 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c4ee78c5-707a-4bc1-9313-b7ab8dddb9a6 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf.28c024cb-fee2-44ef-a224-a74838ecb98d" returned: 0 in 0.549s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c4ee78c5-707a-4bc1-9313-b7ab8dddb9a6 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf.28c024cb-fee2-44ef-a224-a74838ecb98d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:46 devstack sudo[95935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf.28c024cb-fee2-44ef-a224-a74838ecb98d Sep 04 15:54:46 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:46 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-50639159-4723-4bc9-86ef-b5db1d0451b4 req-0ca41197-ee80-4b8d-99ca-445df2ef8d98 tempest-AttachVolumeNegativeTest-1388234156 None] Terminate volume connection completed successfully. Sep 04 15:54:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-50639159-4723-4bc9-86ef-b5db1d0451b4 req-0ca41197-ee80-4b8d-99ca-445df2ef8d98 tempest-AttachVolumeNegativeTest-1388234156 None] Deleting attachment ca5a0077-b938-4a98-be59-054594b82df5. {{(pid=87490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:54:47 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-1e856ec4-8095-4517-8ff5-df8d0c7c947d req-1619285c-63dc-4e37-9a9a-c9ff13f87e51 tempest-AttachVolumeTestJSON-680909899 None] Terminate volume connection completed successfully. Sep 04 15:54:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-1e856ec4-8095-4517-8ff5-df8d0c7c947d req-1619285c-63dc-4e37-9a9a-c9ff13f87e51 tempest-AttachVolumeTestJSON-680909899 None] Deleting attachment 72cd0d3b-9d37-4a17-9d96-b794c1e58fdf. {{(pid=87490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:54:47 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c4ee78c5-707a-4bc1-9313-b7ab8dddb9a6 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf.28c024cb-fee2-44ef-a224-a74838ecb98d" returned: 0 in 0.307s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c4ee78c5-707a-4bc1-9313-b7ab8dddb9a6 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-28c024cb-fee2-44ef-a224-a74838ecb98d" released by "_delete_snapshot" :: held 1.918s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c4ee78c5-707a-4bc1-9313-b7ab8dddb9a6 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-5f04fa9a-acbd-4e21-9cd4-afd8627803cf" released by "delete_snapshot" :: held 1.956s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:47 devstack cinder-volume[87490]: WARNING cinder.quota [None req-c4ee78c5-707a-4bc1-9313-b7ab8dddb9a6 tempest-VolumesSnapshotTestJSON-1655945923 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:54:47 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-c4ee78c5-707a-4bc1-9313-b7ab8dddb9a6 tempest-VolumesSnapshotTestJSON-1655945923 None] Created reservations ['bc9792a7-a302-4462-a052-4cf9ff1e6a99', 'ef6f7c3b-8a4b-4b0f-b0c7-10ed5914f501', 'e3999f2a-854b-4f4d-86db-1758a1418940', '54cd4642-d5c4-4b38-b005-efab719e0964'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:54:47 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-c4ee78c5-707a-4bc1-9313-b7ab8dddb9a6 tempest-VolumesSnapshotTestJSON-1655945923 None] Delete snapshot completed successfully. Sep 04 15:54:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c4ee78c5-707a-4bc1-9313-b7ab8dddb9a6 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-28c024cb-fee2-44ef-a224-a74838ecb98d-delete_snapshot" released by "delete_snapshot" :: held 2.217s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:48 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-383d2f6c-90e2-4d8a-912b-cf6c1ae02602 req-f3074ef1-c947-410f-aaa3-90250a80344c tempest-AttachVolumeTestJSON-680909899 None] Terminate volume connection completed successfully. Sep 04 15:54:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-383d2f6c-90e2-4d8a-912b-cf6c1ae02602 req-f3074ef1-c947-410f-aaa3-90250a80344c tempest-AttachVolumeTestJSON-680909899 None] Deleting attachment e0cab427-3689-424a-b015-be8f9e7ba618. {{(pid=87490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:54:49 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:54:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Flow 'volume_create_manager' (3e0e71a2-18a3-4333-9439-9a643c945adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b848cb7-da04-40eb-bbda-8e896bfb8f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b848cb7-da04-40eb-bbda-8e896bfb8f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1013032962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4867c46f-00dc-45ca-adaf-3a9552cb6c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac98e88b2484d91b26976d2b4e1fd6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:49Z,use_quota=True,user_id='af7b045b02a84c069b6bb5877f41bbfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf9feb0-44c7-4930-b5e9-c57fe0ea0a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf9feb0-44c7-4930-b5e9-c57fe0ea0a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e8ba4e-81ce-451a-9cf7-8e24e241fd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e8ba4e-81ce-451a-9cf7-8e24e241fd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4867c46f-00dc-45ca-adaf-3a9552cb6c9e', 'volume_name': 'volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31f6f5c-ef14-4cb8-82d9-59e36c706c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31f6f5c-ef14-4cb8-82d9-59e36c706c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c032a202-ca2c-4f8c-b3b5-01c79abb4ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:49 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Volume 4867c46f-00dc-45ca-adaf-3a9552cb6c9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e', 'volume_size': 1} Sep 04 15:54:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1013032962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4867c46f-00dc-45ca-adaf-3a9552cb6c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac98e88b2484d91b26976d2b4e1fd6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:49Z,use_quota=True,user_id='af7b045b02a84c069b6bb5877f41bbfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:54:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Creating volume 4867c46f-00dc-45ca-adaf-3a9552cb6c9e {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:54:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:54:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:54:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:54:49 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:54:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:49 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e 1073741824 Sep 04 15:54:49 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:50 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e 1073741824" returned: 0 in 0.570s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:50 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e Sep 04 15:54:50 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:50 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e" returned: 0 in 0.466s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:54:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c032a202-ca2c-4f8c-b3b5-01c79abb4ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364a3611-a286-45ba-8865-c71b8d65dd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:50 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Volume volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e (4867c46f-00dc-45ca-adaf-3a9552cb6c9e): created successfully Sep 04 15:54:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364a3611-a286-45ba-8865-c71b8d65dd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Flow 'volume_create_manager' (3e0e71a2-18a3-4333-9439-9a643c945adc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:50 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-284192f4-7b27-480f-b6f4-cfc4fe1a3f3c tempest-VolumesSnapshotTestJSON-1655945923 None] Created volume successfully. Sep 04 15:54:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d5f43feb-aa50-437e-9119-7f668be9e5b5 tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d5f43feb-aa50-437e-9119-7f668be9e5b5 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:52 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-d5f43feb-aa50-437e-9119-7f668be9e5b5 tempest-VolumesSnapshotTestJSON-1655945923 None] Creating offline snapshot e96aef1b-20a4-459d-9d7b-beb7d65c5b19 of volume 4867c46f-00dc-45ca-adaf-3a9552cb6c9e {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:54:52 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[08212fec-f171-4ad6-bafc-b59e8b3aecca]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d5f43feb-aa50-437e-9119-7f668be9e5b5 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:52 devstack sudo[96019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e Sep 04 15:54:52 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:52 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d5f43feb-aa50-437e-9119-7f668be9e5b5 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e" returned: 0 in 0.614s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d5f43feb-aa50-437e-9119-7f668be9e5b5 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.e96aef1b-20a4-459d-9d7b-beb7d65c5b19 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:52 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.e96aef1b-20a4-459d-9d7b-beb7d65c5b19 1G Sep 04 15:54:52 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:53 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d5f43feb-aa50-437e-9119-7f668be9e5b5 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.e96aef1b-20a4-459d-9d7b-beb7d65c5b19 1G" returned: 0 in 0.597s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d5f43feb-aa50-437e-9119-7f668be9e5b5 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.e96aef1b-20a4-459d-9d7b-beb7d65c5b19 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:53 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.e96aef1b-20a4-459d-9d7b-beb7d65c5b19 Sep 04 15:54:53 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b0888cba-8aa8-49ae-b79f-f0e9fe77a137 tempest-AttachVolumeNegativeTest-1388234156 None] Acquiring lock "cinder-36768858-4b89-4cab-83cd-1d819b7ae985-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:53 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d5f43feb-aa50-437e-9119-7f668be9e5b5 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.e96aef1b-20a4-459d-9d7b-beb7d65c5b19" returned: 0 in 0.414s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:53 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-d5f43feb-aa50-437e-9119-7f668be9e5b5 tempest-VolumesSnapshotTestJSON-1655945923 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.e96aef1b-20a4-459d-9d7b-beb7d65c5b19 is being set with open permissions: ugo+rw Sep 04 15:54:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d5f43feb-aa50-437e-9119-7f668be9e5b5 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.e96aef1b-20a4-459d-9d7b-beb7d65c5b19 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b0888cba-8aa8-49ae-b79f-f0e9fe77a137 tempest-AttachVolumeNegativeTest-1388234156 None] Lock "cinder-36768858-4b89-4cab-83cd-1d819b7ae985-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:53 devstack sudo[96041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.e96aef1b-20a4-459d-9d7b-beb7d65c5b19 Sep 04 15:54:53 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b0888cba-8aa8-49ae-b79f-f0e9fe77a137 tempest-AttachVolumeNegativeTest-1388234156 None] Acquiring lock "cinder-quobyte-36768858-4b89-4cab-83cd-1d819b7ae985" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b0888cba-8aa8-49ae-b79f-f0e9fe77a137 tempest-AttachVolumeNegativeTest-1388234156 None] Lock "cinder-quobyte-36768858-4b89-4cab-83cd-1d819b7ae985" acquired by "delete_volume" :: waited 0.030s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:53 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a93f345-7a61-4cde-8848-091cd465f115]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b0888cba-8aa8-49ae-b79f-f0e9fe77a137 tempest-AttachVolumeNegativeTest-1388234156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-36768858-4b89-4cab-83cd-1d819b7ae985 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:54 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:54 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-36768858-4b89-4cab-83cd-1d819b7ae985 Sep 04 15:54:54 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d5f43feb-aa50-437e-9119-7f668be9e5b5 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.e96aef1b-20a4-459d-9d7b-beb7d65c5b19" returned: 0 in 0.320s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d5f43feb-aa50-437e-9119-7f668be9e5b5 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:54 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.info Sep 04 15:54:54 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:54 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b0888cba-8aa8-49ae-b79f-f0e9fe77a137 tempest-AttachVolumeNegativeTest-1388234156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-36768858-4b89-4cab-83cd-1d819b7ae985" returned: 0 in 0.431s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b0888cba-8aa8-49ae-b79f-f0e9fe77a137 tempest-AttachVolumeNegativeTest-1388234156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-36768858-4b89-4cab-83cd-1d819b7ae985 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:54 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d5f43feb-aa50-437e-9119-7f668be9e5b5 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.info" returned: 0 in 0.263s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:54 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-d5f43feb-aa50-437e-9119-7f668be9e5b5 tempest-VolumesSnapshotTestJSON-1655945923 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.info is being set with open permissions: ugo+rw Sep 04 15:54:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d5f43feb-aa50-437e-9119-7f668be9e5b5 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:54 devstack sudo[96052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-36768858-4b89-4cab-83cd-1d819b7ae985 Sep 04 15:54:54 devstack sudo[96052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:54 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.info Sep 04 15:54:54 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:54 devstack sudo[96052]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b0888cba-8aa8-49ae-b79f-f0e9fe77a137 tempest-AttachVolumeNegativeTest-1388234156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-36768858-4b89-4cab-83cd-1d819b7ae985" returned: 0 in 0.264s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:54 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d5f43feb-aa50-437e-9119-7f668be9e5b5 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.info" returned: 0 in 0.257s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b0888cba-8aa8-49ae-b79f-f0e9fe77a137 tempest-AttachVolumeNegativeTest-1388234156 None] Lock "cinder-quobyte-36768858-4b89-4cab-83cd-1d819b7ae985" released by "delete_volume" :: held 0.751s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d5f43feb-aa50-437e-9119-7f668be9e5b5 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.609s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:54 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-d5f43feb-aa50-437e-9119-7f668be9e5b5 tempest-VolumesSnapshotTestJSON-1655945923 None] Create snapshot completed successfully Sep 04 15:54:54 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-b0888cba-8aa8-49ae-b79f-f0e9fe77a137 tempest-AttachVolumeNegativeTest-1388234156 None] Created reservations ['cb179952-f788-4499-b22d-4f32a0c7007e', '569afc5e-75ca-4ab0-a419-bc7e430b3b83', '5e759c9e-ffad-4368-aeb4-118d0f066ad9', '70865d62-0eba-4220-bb92-7da4cce42624'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:54:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b0888cba-8aa8-49ae-b79f-f0e9fe77a137 tempest-AttachVolumeNegativeTest-1388234156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b0888cba-8aa8-49ae-b79f-f0e9fe77a137 tempest-AttachVolumeNegativeTest-1388234156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b0888cba-8aa8-49ae-b79f-f0e9fe77a137 tempest-AttachVolumeNegativeTest-1388234156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:54:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b0888cba-8aa8-49ae-b79f-f0e9fe77a137 tempest-AttachVolumeNegativeTest-1388234156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:54:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b0888cba-8aa8-49ae-b79f-f0e9fe77a137 tempest-AttachVolumeNegativeTest-1388234156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b0888cba-8aa8-49ae-b79f-f0e9fe77a137 tempest-AttachVolumeNegativeTest-1388234156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:54 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:54:54 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-72c248a6-a0ef-461b-a075-f75e6bf614fc tempest-AttachVolumeNegativeTest-1388234156 None] Acquiring lock "cinder-a270cea7-4f42-4ed6-8396-680038747fff-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-72c248a6-a0ef-461b-a075-f75e6bf614fc tempest-AttachVolumeNegativeTest-1388234156 None] Lock "cinder-a270cea7-4f42-4ed6-8396-680038747fff-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:55 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b0888cba-8aa8-49ae-b79f-f0e9fe77a137 tempest-AttachVolumeNegativeTest-1388234156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.275s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:55 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-b0888cba-8aa8-49ae-b79f-f0e9fe77a137 tempest-AttachVolumeNegativeTest-1388234156 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:54:55 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-b0888cba-8aa8-49ae-b79f-f0e9fe77a137 tempest-AttachVolumeNegativeTest-1388234156 None] Deleted volume successfully. Sep 04 15:54:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-72c248a6-a0ef-461b-a075-f75e6bf614fc tempest-AttachVolumeNegativeTest-1388234156 None] Acquiring lock "cinder-quobyte-a270cea7-4f42-4ed6-8396-680038747fff" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b0888cba-8aa8-49ae-b79f-f0e9fe77a137 tempest-AttachVolumeNegativeTest-1388234156 None] Lock "cinder-36768858-4b89-4cab-83cd-1d819b7ae985-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-72c248a6-a0ef-461b-a075-f75e6bf614fc tempest-AttachVolumeNegativeTest-1388234156 None] Lock "cinder-quobyte-a270cea7-4f42-4ed6-8396-680038747fff" acquired by "delete_volume" :: waited 0.030s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:55 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[1657f666-bd8b-436d-a9d6-f06273358be3]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-72c248a6-a0ef-461b-a075-f75e6bf614fc tempest-AttachVolumeNegativeTest-1388234156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a270cea7-4f42-4ed6-8396-680038747fff {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:55 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a270cea7-4f42-4ed6-8396-680038747fff Sep 04 15:54:55 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:55 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-72c248a6-a0ef-461b-a075-f75e6bf614fc tempest-AttachVolumeNegativeTest-1388234156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a270cea7-4f42-4ed6-8396-680038747fff" returned: 0 in 0.582s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-72c248a6-a0ef-461b-a075-f75e6bf614fc tempest-AttachVolumeNegativeTest-1388234156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a270cea7-4f42-4ed6-8396-680038747fff {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:55 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a270cea7-4f42-4ed6-8396-680038747fff Sep 04 15:54:55 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:55 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Flow 'volume_create_manager' (3647db5c-3ecc-4b4b-aa71-fd12cedf4ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2cddf17-8298-4b95-b274-4063c320339a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2cddf17-8298-4b95-b274-4063c320339a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-76528723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6354d9f-b140-46a0-8032-13a0e6f2c610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac98e88b2484d91b26976d2b4e1fd6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:54:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e96aef1b-20a4-459d-9d7b-beb7d65c5b19,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:54:56Z,use_quota=True,user_id='af7b045b02a84c069b6bb5877f41bbfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fbbc3aa-a714-4489-996c-81c4aac75a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fbbc3aa-a714-4489-996c-81c4aac75a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39a2732-2a3b-44e8-b1a8-1f96734c0a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39a2732-2a3b-44e8-b1a8-1f96734c0a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd6354d9f-b140-46a0-8032-13a0e6f2c610', 'volume_name': 'volume-d6354d9f-b140-46a0-8032-13a0e6f2c610', 'volume_size': 2, 'snapshot_id': 'e96aef1b-20a4-459d-9d7b-beb7d65c5b19'}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e68aaa-74fb-42ad-a563-b64f079a3261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e68aaa-74fb-42ad-a563-b64f079a3261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:54:56 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a4034e-f216-4b38-9e82-bff5f1e1f771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:54:56 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Volume d6354d9f-b140-46a0-8032-13a0e6f2c610: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d6354d9f-b140-46a0-8032-13a0e6f2c610', 'volume_size': 2, 'snapshot_id': 'e96aef1b-20a4-459d-9d7b-beb7d65c5b19'} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-72c248a6-a0ef-461b-a075-f75e6bf614fc tempest-AttachVolumeNegativeTest-1388234156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a270cea7-4f42-4ed6-8396-680038747fff" returned: 0 in 0.321s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "cinder-quobyte-e96aef1b-20a4-459d-9d7b-beb7d65c5b19-d6354d9f-b140-46a0-8032-13a0e6f2c610" by "_create_volume_from_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-72c248a6-a0ef-461b-a075-f75e6bf614fc tempest-AttachVolumeNegativeTest-1388234156 None] Lock "cinder-quobyte-a270cea7-4f42-4ed6-8396-680038747fff" released by "delete_volume" :: held 0.960s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-e96aef1b-20a4-459d-9d7b-beb7d65c5b19-d6354d9f-b140-46a0-8032-13a0e6f2c610" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Creating volume d6354d9f-b140-46a0-8032-13a0e6f2c610 from snapshot e96aef1b-20a4-459d-9d7b-beb7d65c5b19 {{(pid=87490) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "cinder-quobyte-d6354d9f-b140-46a0-8032-13a0e6f2c610" by "_copy_volume_from_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-d6354d9f-b140-46a0-8032-13a0e6f2c610" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] snapshot: e96aef1b-20a4-459d-9d7b-beb7d65c5b19, volume: d6354d9f-b140-46a0-8032-13a0e6f2c610, {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[848c802a-d5d9-40dc-88c9-cf3e1fc22fc4]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.e96aef1b-20a4-459d-9d7b-beb7d65c5b19 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-72c248a6-a0ef-461b-a075-f75e6bf614fc tempest-AttachVolumeNegativeTest-1388234156 None] Created reservations ['49d1f706-97f6-47c4-8a4d-484e313984e4', '7b8cb1a2-2156-4ced-9d03-25a3abf91480', 'ae1ef282-ebbc-4c87-b554-4dd040c90825', '41dd55b3-b7ad-43e6-adf0-7a30092f8815'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-72c248a6-a0ef-461b-a075-f75e6bf614fc tempest-AttachVolumeNegativeTest-1388234156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-72c248a6-a0ef-461b-a075-f75e6bf614fc tempest-AttachVolumeNegativeTest-1388234156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-72c248a6-a0ef-461b-a075-f75e6bf614fc tempest-AttachVolumeNegativeTest-1388234156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-72c248a6-a0ef-461b-a075-f75e6bf614fc tempest-AttachVolumeNegativeTest-1388234156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-72c248a6-a0ef-461b-a075-f75e6bf614fc tempest-AttachVolumeNegativeTest-1388234156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-72c248a6-a0ef-461b-a075-f75e6bf614fc tempest-AttachVolumeNegativeTest-1388234156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:56 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.e96aef1b-20a4-459d-9d7b-beb7d65c5b19 Sep 04 15:54:56 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:56 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:54:56 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1d1d5229-6a48-41d9-baf5-dc778d0101d6 tempest-AttachVolumeTestJSON-680909899 None] Acquiring lock "cinder-d6bd8421-f7a5-4bed-b2c7-b66c1d85720c-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1d1d5229-6a48-41d9-baf5-dc778d0101d6 tempest-AttachVolumeTestJSON-680909899 None] Lock "cinder-d6bd8421-f7a5-4bed-b2c7-b66c1d85720c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1d1d5229-6a48-41d9-baf5-dc778d0101d6 tempest-AttachVolumeTestJSON-680909899 None] Acquiring lock "cinder-quobyte-d6bd8421-f7a5-4bed-b2c7-b66c1d85720c" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1d1d5229-6a48-41d9-baf5-dc778d0101d6 tempest-AttachVolumeTestJSON-680909899 None] Lock "cinder-quobyte-d6bd8421-f7a5-4bed-b2c7-b66c1d85720c" acquired by "delete_volume" :: waited 0.035s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fbabfb-3940-498b-b932-ce435dd34482]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1d1d5229-6a48-41d9-baf5-dc778d0101d6 tempest-AttachVolumeTestJSON-680909899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d6bd8421-f7a5-4bed-b2c7-b66c1d85720c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:56 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.e96aef1b-20a4-459d-9d7b-beb7d65c5b19" returned: 0 in 0.494s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b86c125-653f-4368-99db-65428caa1c08]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:56 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-72c248a6-a0ef-461b-a075-f75e6bf614fc tempest-AttachVolumeNegativeTest-1388234156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.411s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-72c248a6-a0ef-461b-a075-f75e6bf614fc tempest-AttachVolumeNegativeTest-1388234156 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:54:56 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-72c248a6-a0ef-461b-a075-f75e6bf614fc tempest-AttachVolumeNegativeTest-1388234156 None] Deleted volume successfully. Sep 04 15:54:56 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d6bd8421-f7a5-4bed-b2c7-b66c1d85720c Sep 04 15:54:56 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-72c248a6-a0ef-461b-a075-f75e6bf614fc tempest-AttachVolumeNegativeTest-1388234156 None] Lock "cinder-a270cea7-4f42-4ed6-8396-680038747fff-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:56 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e Sep 04 15:54:56 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:57 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1d1d5229-6a48-41d9-baf5-dc778d0101d6 tempest-AttachVolumeTestJSON-680909899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d6bd8421-f7a5-4bed-b2c7-b66c1d85720c" returned: 0 in 0.353s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1d1d5229-6a48-41d9-baf5-dc778d0101d6 tempest-AttachVolumeTestJSON-680909899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d6bd8421-f7a5-4bed-b2c7-b66c1d85720c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:57 devstack sudo[96086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d6bd8421-f7a5-4bed-b2c7-b66c1d85720c Sep 04 15:54:57 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:57 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e" returned: 0 in 0.372s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 15:54:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Creating direct copy from snapshot {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 15:54:57 devstack cinder-volume[87490]: DEBUG cinder.utils [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Path /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d6354d9f-b140-46a0-8032-13a0e6f2c610 not found in is_blk_device check {{(pid=87490) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 15:54:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d6354d9f-b140-46a0-8032-13a0e6f2c610 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:57 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d6354d9f-b140-46a0-8032-13a0e6f2c610 Sep 04 15:54:57 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:57 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1d1d5229-6a48-41d9-baf5-dc778d0101d6 tempest-AttachVolumeTestJSON-680909899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d6bd8421-f7a5-4bed-b2c7-b66c1d85720c" returned: 0 in 0.255s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1d1d5229-6a48-41d9-baf5-dc778d0101d6 tempest-AttachVolumeTestJSON-680909899 None] Lock "cinder-quobyte-d6bd8421-f7a5-4bed-b2c7-b66c1d85720c" released by "delete_volume" :: held 0.662s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:57 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-1d1d5229-6a48-41d9-baf5-dc778d0101d6 tempest-AttachVolumeTestJSON-680909899 None] Created reservations ['894bc748-2cb1-411b-aa6a-997125f3aa3d', '9eadba7a-b342-4003-8e41-053b4caa1702', '92d29005-52ee-4d11-a118-ce6057474ba0', '5488a7fd-43d3-416f-a29a-e3df36668b9c'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:54:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1d1d5229-6a48-41d9-baf5-dc778d0101d6 tempest-AttachVolumeTestJSON-680909899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1d1d5229-6a48-41d9-baf5-dc778d0101d6 tempest-AttachVolumeTestJSON-680909899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1d1d5229-6a48-41d9-baf5-dc778d0101d6 tempest-AttachVolumeTestJSON-680909899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:54:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1d1d5229-6a48-41d9-baf5-dc778d0101d6 tempest-AttachVolumeTestJSON-680909899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:54:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1d1d5229-6a48-41d9-baf5-dc778d0101d6 tempest-AttachVolumeTestJSON-680909899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1d1d5229-6a48-41d9-baf5-dc778d0101d6 tempest-AttachVolumeTestJSON-680909899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:57 devstack sudo[96095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:54:57 devstack sudo[96095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0df56e7b-de01-44aa-bdf6-b8bb11e71d56 tempest-AttachVolumeNegativeTest-1388234156 None] Acquiring lock "cinder-23d1b322-eda0-4370-8eb2-815cb373ae17-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0df56e7b-de01-44aa-bdf6-b8bb11e71d56 tempest-AttachVolumeNegativeTest-1388234156 None] Lock "cinder-23d1b322-eda0-4370-8eb2-815cb373ae17-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0df56e7b-de01-44aa-bdf6-b8bb11e71d56 tempest-AttachVolumeNegativeTest-1388234156 None] Acquiring lock "cinder-quobyte-23d1b322-eda0-4370-8eb2-815cb373ae17" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0df56e7b-de01-44aa-bdf6-b8bb11e71d56 tempest-AttachVolumeNegativeTest-1388234156 None] Lock "cinder-quobyte-23d1b322-eda0-4370-8eb2-815cb373ae17" acquired by "delete_volume" :: waited 0.026s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:57 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6c26af-0893-44d2-a806-b2e40318ad5f]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0df56e7b-de01-44aa-bdf6-b8bb11e71d56 tempest-AttachVolumeNegativeTest-1388234156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-23d1b322-eda0-4370-8eb2-815cb373ae17 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:57 devstack sudo[96095]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e67f9907-a22f-4601-82dd-477d79e99bef tempest-AttachVolumeTestJSON-680909899 None] Acquiring lock "cinder-3738d859-c36e-49f1-9857-803a9f87461c-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1d1d5229-6a48-41d9-baf5-dc778d0101d6 tempest-AttachVolumeTestJSON-680909899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.493s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:57 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-1d1d5229-6a48-41d9-baf5-dc778d0101d6 tempest-AttachVolumeTestJSON-680909899 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:54:58 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-1d1d5229-6a48-41d9-baf5-dc778d0101d6 tempest-AttachVolumeTestJSON-680909899 None] Deleted volume successfully. Sep 04 15:54:58 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e67f9907-a22f-4601-82dd-477d79e99bef tempest-AttachVolumeTestJSON-680909899 None] Lock "cinder-3738d859-c36e-49f1-9857-803a9f87461c-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:58 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1d1d5229-6a48-41d9-baf5-dc778d0101d6 tempest-AttachVolumeTestJSON-680909899 None] Lock "cinder-d6bd8421-f7a5-4bed-b2c7-b66c1d85720c-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:58 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e67f9907-a22f-4601-82dd-477d79e99bef tempest-AttachVolumeTestJSON-680909899 None] Acquiring lock "cinder-quobyte-3738d859-c36e-49f1-9857-803a9f87461c" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:54:58 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e67f9907-a22f-4601-82dd-477d79e99bef tempest-AttachVolumeTestJSON-680909899 None] Lock "cinder-quobyte-3738d859-c36e-49f1-9857-803a9f87461c" acquired by "delete_volume" :: waited 0.041s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:54:58 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ef71d2-f7ce-4bae-aae3-18af81054f29]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:54:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e67f9907-a22f-4601-82dd-477d79e99bef tempest-AttachVolumeTestJSON-680909899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3738d859-c36e-49f1-9857-803a9f87461c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:58 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-23d1b322-eda0-4370-8eb2-815cb373ae17 Sep 04 15:54:58 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:58 devstack sudo[96108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3738d859-c36e-49f1-9857-803a9f87461c Sep 04 15:54:58 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:58 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0df56e7b-de01-44aa-bdf6-b8bb11e71d56 tempest-AttachVolumeNegativeTest-1388234156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-23d1b322-eda0-4370-8eb2-815cb373ae17" returned: 0 in 0.990s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0df56e7b-de01-44aa-bdf6-b8bb11e71d56 tempest-AttachVolumeNegativeTest-1388234156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-23d1b322-eda0-4370-8eb2-815cb373ae17 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:58 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-23d1b322-eda0-4370-8eb2-815cb373ae17 Sep 04 15:54:58 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:59 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e67f9907-a22f-4601-82dd-477d79e99bef tempest-AttachVolumeTestJSON-680909899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3738d859-c36e-49f1-9857-803a9f87461c" returned: 0 in 0.936s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e67f9907-a22f-4601-82dd-477d79e99bef tempest-AttachVolumeTestJSON-680909899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3738d859-c36e-49f1-9857-803a9f87461c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:54:59 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3738d859-c36e-49f1-9857-803a9f87461c Sep 04 15:54:59 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:54:59 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0df56e7b-de01-44aa-bdf6-b8bb11e71d56 tempest-AttachVolumeNegativeTest-1388234156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-23d1b322-eda0-4370-8eb2-815cb373ae17" returned: 0 in 0.623s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:59 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0df56e7b-de01-44aa-bdf6-b8bb11e71d56 tempest-AttachVolumeNegativeTest-1388234156 None] Lock "cinder-quobyte-23d1b322-eda0-4370-8eb2-815cb373ae17" released by "delete_volume" :: held 1.701s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:59 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Sep 04 15:54:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e67f9907-a22f-4601-82dd-477d79e99bef tempest-AttachVolumeTestJSON-680909899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3738d859-c36e-49f1-9857-803a9f87461c" returned: 0 in 0.480s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:54:59 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e67f9907-a22f-4601-82dd-477d79e99bef tempest-AttachVolumeTestJSON-680909899 None] Lock "cinder-quobyte-3738d859-c36e-49f1-9857-803a9f87461c" released by "delete_volume" :: held 1.522s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:54:59 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-0df56e7b-de01-44aa-bdf6-b8bb11e71d56 tempest-AttachVolumeNegativeTest-1388234156 None] Created reservations ['35e11873-4356-48b4-8003-fe1ad8bd9d46', '6f867eb2-abd1-4fb6-906f-93c42828df39', '8612d375-2dc3-4b52-9fc6-7b317011e324', '95408747-6829-48a1-a850-6d749d5a241c'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:54:59 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-e67f9907-a22f-4601-82dd-477d79e99bef tempest-AttachVolumeTestJSON-680909899 None] Created reservations ['40012558-12e5-42cc-9ebd-650fc06cf0bc', '19d209fe-50cb-41c4-a993-f57c71e37faa', '03c1260d-00ca-4c80-b578-d5679564f302', '09c375a2-20e1-41a9-90cf-831aa65e455d'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:54:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0df56e7b-de01-44aa-bdf6-b8bb11e71d56 tempest-AttachVolumeNegativeTest-1388234156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:54:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0df56e7b-de01-44aa-bdf6-b8bb11e71d56 tempest-AttachVolumeNegativeTest-1388234156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:54:59 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-0df56e7b-de01-44aa-bdf6-b8bb11e71d56 tempest-AttachVolumeNegativeTest-1388234156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:54:59 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-0df56e7b-de01-44aa-bdf6-b8bb11e71d56 tempest-AttachVolumeNegativeTest-1388234156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:54:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0df56e7b-de01-44aa-bdf6-b8bb11e71d56 tempest-AttachVolumeNegativeTest-1388234156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:54:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0df56e7b-de01-44aa-bdf6-b8bb11e71d56 tempest-AttachVolumeNegativeTest-1388234156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e67f9907-a22f-4601-82dd-477d79e99bef tempest-AttachVolumeTestJSON-680909899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e67f9907-a22f-4601-82dd-477d79e99bef tempest-AttachVolumeTestJSON-680909899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:00 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e67f9907-a22f-4601-82dd-477d79e99bef tempest-AttachVolumeTestJSON-680909899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:55:00 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:55:00 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:00 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e67f9907-a22f-4601-82dd-477d79e99bef tempest-AttachVolumeTestJSON-680909899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:55:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e67f9907-a22f-4601-82dd-477d79e99bef tempest-AttachVolumeTestJSON-680909899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e67f9907-a22f-4601-82dd-477d79e99bef tempest-AttachVolumeTestJSON-680909899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:00 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:55:00 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:00 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e67f9907-a22f-4601-82dd-477d79e99bef tempest-AttachVolumeTestJSON-680909899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.798s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:00 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-e67f9907-a22f-4601-82dd-477d79e99bef tempest-AttachVolumeTestJSON-680909899 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:55:00 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-e67f9907-a22f-4601-82dd-477d79e99bef tempest-AttachVolumeTestJSON-680909899 None] Deleted volume successfully. Sep 04 15:55:00 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0df56e7b-de01-44aa-bdf6-b8bb11e71d56 tempest-AttachVolumeNegativeTest-1388234156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.956s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:00 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-0df56e7b-de01-44aa-bdf6-b8bb11e71d56 tempest-AttachVolumeNegativeTest-1388234156 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:55:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-de099294-5aea-45fe-babc-3c6eb3be1b8a tempest-AttachVolumeTestJSON-680909899 None] Acquiring lock "cinder-2ee2f907-bcc3-48bc-9a84-884e99034127-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:00 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-0df56e7b-de01-44aa-bdf6-b8bb11e71d56 tempest-AttachVolumeNegativeTest-1388234156 None] Deleted volume successfully. Sep 04 15:55:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e67f9907-a22f-4601-82dd-477d79e99bef tempest-AttachVolumeTestJSON-680909899 None] Lock "cinder-3738d859-c36e-49f1-9857-803a9f87461c-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-de099294-5aea-45fe-babc-3c6eb3be1b8a tempest-AttachVolumeTestJSON-680909899 None] Lock "cinder-2ee2f907-bcc3-48bc-9a84-884e99034127-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0df56e7b-de01-44aa-bdf6-b8bb11e71d56 tempest-AttachVolumeNegativeTest-1388234156 None] Lock "cinder-23d1b322-eda0-4370-8eb2-815cb373ae17-delete_volume" released by "delete_volume" :: held 3.364s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-de099294-5aea-45fe-babc-3c6eb3be1b8a tempest-AttachVolumeTestJSON-680909899 None] Acquiring lock "cinder-quobyte-2ee2f907-bcc3-48bc-9a84-884e99034127" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-de099294-5aea-45fe-babc-3c6eb3be1b8a tempest-AttachVolumeTestJSON-680909899 None] Lock "cinder-quobyte-2ee2f907-bcc3-48bc-9a84-884e99034127" acquired by "delete_volume" :: waited 0.034s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:01 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8209b6-e776-41e8-a005-6a46d61d33a6]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-de099294-5aea-45fe-babc-3c6eb3be1b8a tempest-AttachVolumeTestJSON-680909899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2ee2f907-bcc3-48bc-9a84-884e99034127 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:01 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2ee2f907-bcc3-48bc-9a84-884e99034127 Sep 04 15:55:01 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:02 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-de099294-5aea-45fe-babc-3c6eb3be1b8a tempest-AttachVolumeTestJSON-680909899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2ee2f907-bcc3-48bc-9a84-884e99034127" returned: 0 in 0.813s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-de099294-5aea-45fe-babc-3c6eb3be1b8a tempest-AttachVolumeTestJSON-680909899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2ee2f907-bcc3-48bc-9a84-884e99034127 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:02 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2ee2f907-bcc3-48bc-9a84-884e99034127 Sep 04 15:55:02 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:02 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d6354d9f-b140-46a0-8032-13a0e6f2c610" returned: 0 in 5.253s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:02 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e, size 1024.00 MB, duration 5.25 sec, destination /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d6354d9f-b140-46a0-8032-13a0e6f2c610 {{(pid=87490) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 15:55:02 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Converted 1024.00 MB image at 194.89 MB/s Sep 04 15:55:02 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d6354d9f-b140-46a0-8032-13a0e6f2c610 is being set with open permissions: ugo+rw Sep 04 15:55:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d6354d9f-b140-46a0-8032-13a0e6f2c610 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:02 devstack sudo[96140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d6354d9f-b140-46a0-8032-13a0e6f2c610 Sep 04 15:55:02 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:02 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-de099294-5aea-45fe-babc-3c6eb3be1b8a tempest-AttachVolumeTestJSON-680909899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2ee2f907-bcc3-48bc-9a84-884e99034127" returned: 0 in 0.507s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:02 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-de099294-5aea-45fe-babc-3c6eb3be1b8a tempest-AttachVolumeTestJSON-680909899 None] Lock "cinder-quobyte-2ee2f907-bcc3-48bc-9a84-884e99034127" released by "delete_volume" :: held 1.397s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:02 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-de099294-5aea-45fe-babc-3c6eb3be1b8a tempest-AttachVolumeTestJSON-680909899 None] Created reservations ['ea6502b2-4b19-44fa-8380-d27c4a6d52b1', 'a1b0bd46-4f7f-4b7d-af7d-ad5671a5ad8a', '9e51f612-986f-4432-a2ab-4471cf662d88', '25c07d58-acac-4a95-8a30-dfc107dce757'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:55:02 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d6354d9f-b140-46a0-8032-13a0e6f2c610" returned: 0 in 0.277s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:02 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-d6354d9f-b140-46a0-8032-13a0e6f2c610" released by "_copy_volume_from_snapshot" :: held 6.494s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:02 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-e96aef1b-20a4-459d-9d7b-beb7d65c5b19-d6354d9f-b140-46a0-8032-13a0e6f2c610" released by "_create_volume_from_snapshot" :: held 6.585s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.609s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-de099294-5aea-45fe-babc-3c6eb3be1b8a tempest-AttachVolumeTestJSON-680909899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-de099294-5aea-45fe-babc-3c6eb3be1b8a tempest-AttachVolumeTestJSON-680909899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:02 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-de099294-5aea-45fe-babc-3c6eb3be1b8a tempest-AttachVolumeTestJSON-680909899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:55:02 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-de099294-5aea-45fe-babc-3c6eb3be1b8a tempest-AttachVolumeTestJSON-680909899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:55:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-de099294-5aea-45fe-babc-3c6eb3be1b8a tempest-AttachVolumeTestJSON-680909899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-de099294-5aea-45fe-babc-3c6eb3be1b8a tempest-AttachVolumeTestJSON-680909899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:02 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:55:02 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a4034e-f216-4b38-9e82-bff5f1e1f771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6354d9f-b140-46a0-8032-13a0e6f2c610', 'volume_size': 2, 'snapshot_id': 'e96aef1b-20a4-459d-9d7b-beb7d65c5b19'}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a52f58e-ffc6-4fae-afb2-007951855803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:02 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Volume volume-d6354d9f-b140-46a0-8032-13a0e6f2c610 (d6354d9f-b140-46a0-8032-13a0e6f2c610): created successfully Sep 04 15:55:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a52f58e-ffc6-4fae-afb2-007951855803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Flow 'volume_create_manager' (3647db5c-3ecc-4b4b-aa71-fd12cedf4ae0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:02 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-7bf8c03b-d947-4c4a-9ad5-da6d3fd2b797 tempest-VolumesSnapshotTestJSON-1655945923 None] Created volume successfully. Sep 04 15:55:03 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-de099294-5aea-45fe-babc-3c6eb3be1b8a tempest-AttachVolumeTestJSON-680909899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.305s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:03 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-de099294-5aea-45fe-babc-3c6eb3be1b8a tempest-AttachVolumeTestJSON-680909899 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:55:03 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-de099294-5aea-45fe-babc-3c6eb3be1b8a tempest-AttachVolumeTestJSON-680909899 None] Deleted volume successfully. Sep 04 15:55:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-de099294-5aea-45fe-babc-3c6eb3be1b8a tempest-AttachVolumeTestJSON-680909899 None] Lock "cinder-2ee2f907-bcc3-48bc-9a84-884e99034127-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-580edecc-6595-4d9d-beff-0cd3dfc738fb tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "cinder-d6354d9f-b140-46a0-8032-13a0e6f2c610-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-580edecc-6595-4d9d-beff-0cd3dfc738fb tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-d6354d9f-b140-46a0-8032-13a0e6f2c610-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-580edecc-6595-4d9d-beff-0cd3dfc738fb tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "cinder-quobyte-d6354d9f-b140-46a0-8032-13a0e6f2c610" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-580edecc-6595-4d9d-beff-0cd3dfc738fb tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-d6354d9f-b140-46a0-8032-13a0e6f2c610" acquired by "delete_volume" :: waited 0.020s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:04 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec09970-7809-47a9-aba7-7a6b12ea45a4]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-580edecc-6595-4d9d-beff-0cd3dfc738fb tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d6354d9f-b140-46a0-8032-13a0e6f2c610 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:04 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d6354d9f-b140-46a0-8032-13a0e6f2c610 Sep 04 15:55:04 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:04 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-580edecc-6595-4d9d-beff-0cd3dfc738fb tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d6354d9f-b140-46a0-8032-13a0e6f2c610" returned: 0 in 0.494s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-580edecc-6595-4d9d-beff-0cd3dfc738fb tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d6354d9f-b140-46a0-8032-13a0e6f2c610 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:04 devstack sudo[96156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d6354d9f-b140-46a0-8032-13a0e6f2c610 Sep 04 15:55:04 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:04 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-580edecc-6595-4d9d-beff-0cd3dfc738fb tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d6354d9f-b140-46a0-8032-13a0e6f2c610" returned: 0 in 0.411s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:04 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-580edecc-6595-4d9d-beff-0cd3dfc738fb tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-d6354d9f-b140-46a0-8032-13a0e6f2c610" released by "delete_volume" :: held 0.981s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:05 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-580edecc-6595-4d9d-beff-0cd3dfc738fb tempest-VolumesSnapshotTestJSON-1655945923 None] Created reservations ['ddd462dd-b6c9-4487-aa8a-2a96736dcc0e', '9e87f023-1372-4974-ac08-adbe2de3551b', '2f4f067a-9005-47e9-8927-11bac50b05d9', '9713d59b-4bc6-4e3e-af20-02a819a5a696'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:55:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-580edecc-6595-4d9d-beff-0cd3dfc738fb tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-580edecc-6595-4d9d-beff-0cd3dfc738fb tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:05 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-580edecc-6595-4d9d-beff-0cd3dfc738fb tempest-VolumesSnapshotTestJSON-1655945923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:55:05 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-580edecc-6595-4d9d-beff-0cd3dfc738fb tempest-VolumesSnapshotTestJSON-1655945923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:55:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-580edecc-6595-4d9d-beff-0cd3dfc738fb tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-580edecc-6595-4d9d-beff-0cd3dfc738fb tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:05 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:55:05 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:05 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-580edecc-6595-4d9d-beff-0cd3dfc738fb tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.325s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:05 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-580edecc-6595-4d9d-beff-0cd3dfc738fb tempest-VolumesSnapshotTestJSON-1655945923 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:55:05 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-580edecc-6595-4d9d-beff-0cd3dfc738fb tempest-VolumesSnapshotTestJSON-1655945923 None] Deleted volume successfully. Sep 04 15:55:05 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-580edecc-6595-4d9d-beff-0cd3dfc738fb tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-d6354d9f-b140-46a0-8032-13a0e6f2c610-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-55dda3b9-5521-44be-896f-57ddf7dce62b tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "cinder-e96aef1b-20a4-459d-9d7b-beb7d65c5b19-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-55dda3b9-5521-44be-896f-57ddf7dce62b tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-e96aef1b-20a4-459d-9d7b-beb7d65c5b19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-55dda3b9-5521-44be-896f-57ddf7dce62b tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "cinder-quobyte-4867c46f-00dc-45ca-adaf-3a9552cb6c9e" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-55dda3b9-5521-44be-896f-57ddf7dce62b tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-4867c46f-00dc-45ca-adaf-3a9552cb6c9e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-55dda3b9-5521-44be-896f-57ddf7dce62b tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "cinder-quobyte-e96aef1b-20a4-459d-9d7b-beb7d65c5b19" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-55dda3b9-5521-44be-896f-57ddf7dce62b tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-e96aef1b-20a4-459d-9d7b-beb7d65c5b19" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:06 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-55dda3b9-5521-44be-896f-57ddf7dce62b tempest-VolumesSnapshotTestJSON-1655945923 None] Deleting offline snapshot e96aef1b-20a4-459d-9d7b-beb7d65c5b19 of volume 4867c46f-00dc-45ca-adaf-3a9552cb6c9e {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:55:06 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-55dda3b9-5521-44be-896f-57ddf7dce62b tempest-VolumesSnapshotTestJSON-1655945923 None] snapshot_file for this snap is: volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.e96aef1b-20a4-459d-9d7b-beb7d65c5b19 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:55:06 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cbcc0f-b919-462a-bb00-6e8e3796ede6]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-55dda3b9-5521-44be-896f-57ddf7dce62b tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.e96aef1b-20a4-459d-9d7b-beb7d65c5b19 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:06 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.e96aef1b-20a4-459d-9d7b-beb7d65c5b19 Sep 04 15:55:06 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:06 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-55dda3b9-5521-44be-896f-57ddf7dce62b tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.e96aef1b-20a4-459d-9d7b-beb7d65c5b19" returned: 0 in 0.449s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:06 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-55dda3b9-5521-44be-896f-57ddf7dce62b tempest-VolumesSnapshotTestJSON-1655945923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:55:06 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a3a485-54f8-4f91-a778-6f267c92769e]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-55dda3b9-5521-44be-896f-57ddf7dce62b tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:06 devstack sudo[96519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e Sep 04 15:55:06 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:07 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-55dda3b9-5521-44be-896f-57ddf7dce62b tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e" returned: 0 in 0.549s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-55dda3b9-5521-44be-896f-57ddf7dce62b tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.e96aef1b-20a4-459d-9d7b-beb7d65c5b19 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:07 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.e96aef1b-20a4-459d-9d7b-beb7d65c5b19 Sep 04 15:55:07 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:07 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-55dda3b9-5521-44be-896f-57ddf7dce62b tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.e96aef1b-20a4-459d-9d7b-beb7d65c5b19" returned: 0 in 0.552s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-55dda3b9-5521-44be-896f-57ddf7dce62b tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.e96aef1b-20a4-459d-9d7b-beb7d65c5b19 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:07 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.e96aef1b-20a4-459d-9d7b-beb7d65c5b19 Sep 04 15:55:07 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:08 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-55dda3b9-5521-44be-896f-57ddf7dce62b tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e.e96aef1b-20a4-459d-9d7b-beb7d65c5b19" returned: 0 in 0.305s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:08 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-55dda3b9-5521-44be-896f-57ddf7dce62b tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-e96aef1b-20a4-459d-9d7b-beb7d65c5b19" released by "_delete_snapshot" :: held 1.990s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:08 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-55dda3b9-5521-44be-896f-57ddf7dce62b tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-4867c46f-00dc-45ca-adaf-3a9552cb6c9e" released by "delete_snapshot" :: held 2.020s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:08 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-55dda3b9-5521-44be-896f-57ddf7dce62b tempest-VolumesSnapshotTestJSON-1655945923 None] Created reservations ['3b843632-9775-43a2-8515-702869b62b28', '3bd20c28-a4ec-4967-89fd-5b5c7ea7e2c5', '9d1b0da6-1d75-41f4-9fac-9ea08a799cab', '117333dd-0696-4ed1-9a90-6eb578b607b9'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:55:08 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-55dda3b9-5521-44be-896f-57ddf7dce62b tempest-VolumesSnapshotTestJSON-1655945923 None] Delete snapshot completed successfully. Sep 04 15:55:08 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-55dda3b9-5521-44be-896f-57ddf7dce62b tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-e96aef1b-20a4-459d-9d7b-beb7d65c5b19-delete_snapshot" released by "delete_snapshot" :: held 2.236s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:09 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5fda5131-998f-47b6-946e-fe1a719c3b77 tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "cinder-4867c46f-00dc-45ca-adaf-3a9552cb6c9e-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:09 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5fda5131-998f-47b6-946e-fe1a719c3b77 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-4867c46f-00dc-45ca-adaf-3a9552cb6c9e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:09 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5fda5131-998f-47b6-946e-fe1a719c3b77 tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "cinder-quobyte-4867c46f-00dc-45ca-adaf-3a9552cb6c9e" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:09 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5fda5131-998f-47b6-946e-fe1a719c3b77 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-4867c46f-00dc-45ca-adaf-3a9552cb6c9e" acquired by "delete_volume" :: waited 0.059s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:09 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[34197b24-7eac-4249-a288-3d74f7bc1582]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5fda5131-998f-47b6-946e-fe1a719c3b77 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:09 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e Sep 04 15:55:09 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:10 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5fda5131-998f-47b6-946e-fe1a719c3b77 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e" returned: 0 in 0.496s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5fda5131-998f-47b6-946e-fe1a719c3b77 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:10 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e Sep 04 15:55:10 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:10 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5fda5131-998f-47b6-946e-fe1a719c3b77 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4867c46f-00dc-45ca-adaf-3a9552cb6c9e" returned: 0 in 0.404s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:10 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5fda5131-998f-47b6-946e-fe1a719c3b77 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-4867c46f-00dc-45ca-adaf-3a9552cb6c9e" released by "delete_volume" :: held 1.042s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:10 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-5fda5131-998f-47b6-946e-fe1a719c3b77 tempest-VolumesSnapshotTestJSON-1655945923 None] Created reservations ['2523c763-7f26-4da8-8d51-de757876eb3c', '38b3beb5-6091-46ef-98e0-7018f94ebfee', '1d12f957-eaef-4096-9da0-e8aa4ee80d09', '5ecf00ca-1c25-43dc-a778-bb61b14704d2'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:55:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5fda5131-998f-47b6-946e-fe1a719c3b77 tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5fda5131-998f-47b6-946e-fe1a719c3b77 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-5fda5131-998f-47b6-946e-fe1a719c3b77 tempest-VolumesSnapshotTestJSON-1655945923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:55:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-5fda5131-998f-47b6-946e-fe1a719c3b77 tempest-VolumesSnapshotTestJSON-1655945923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:55:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5fda5131-998f-47b6-946e-fe1a719c3b77 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5fda5131-998f-47b6-946e-fe1a719c3b77 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:10 devstack sudo[96548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:55:10 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:10 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-999b10b5-b7c9-4c3a-b178-85073b108a0e tempest-AttachVolumeShelveTestJSON-2071262142 None] Acquiring lock "cinder-23e54da6-16be-4004-8d4f-35dc6a54ec2b-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:11 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-999b10b5-b7c9-4c3a-b178-85073b108a0e tempest-AttachVolumeShelveTestJSON-2071262142 None] Lock "cinder-23e54da6-16be-4004-8d4f-35dc6a54ec2b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:11 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-999b10b5-b7c9-4c3a-b178-85073b108a0e tempest-AttachVolumeShelveTestJSON-2071262142 None] Acquiring lock "cinder-quobyte-23e54da6-16be-4004-8d4f-35dc6a54ec2b" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:11 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-999b10b5-b7c9-4c3a-b178-85073b108a0e tempest-AttachVolumeShelveTestJSON-2071262142 None] Lock "cinder-quobyte-23e54da6-16be-4004-8d4f-35dc6a54ec2b" acquired by "delete_volume" :: waited 0.026s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:11 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5c08c0-40f7-4fff-800d-e3bd1e73ed44]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-999b10b5-b7c9-4c3a-b178-85073b108a0e tempest-AttachVolumeShelveTestJSON-2071262142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-23e54da6-16be-4004-8d4f-35dc6a54ec2b {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:11 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5fda5131-998f-47b6-946e-fe1a719c3b77 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.344s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:11 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-5fda5131-998f-47b6-946e-fe1a719c3b77 tempest-VolumesSnapshotTestJSON-1655945923 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:55:11 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-5fda5131-998f-47b6-946e-fe1a719c3b77 tempest-VolumesSnapshotTestJSON-1655945923 None] Deleted volume successfully. Sep 04 15:55:11 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-23e54da6-16be-4004-8d4f-35dc6a54ec2b Sep 04 15:55:11 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:11 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5fda5131-998f-47b6-946e-fe1a719c3b77 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-4867c46f-00dc-45ca-adaf-3a9552cb6c9e-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:11 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-999b10b5-b7c9-4c3a-b178-85073b108a0e tempest-AttachVolumeShelveTestJSON-2071262142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-23e54da6-16be-4004-8d4f-35dc6a54ec2b" returned: 0 in 0.410s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-999b10b5-b7c9-4c3a-b178-85073b108a0e tempest-AttachVolumeShelveTestJSON-2071262142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-23e54da6-16be-4004-8d4f-35dc6a54ec2b {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:11 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-23e54da6-16be-4004-8d4f-35dc6a54ec2b Sep 04 15:55:11 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:11 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-999b10b5-b7c9-4c3a-b178-85073b108a0e tempest-AttachVolumeShelveTestJSON-2071262142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-23e54da6-16be-4004-8d4f-35dc6a54ec2b" returned: 0 in 0.308s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:11 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-999b10b5-b7c9-4c3a-b178-85073b108a0e tempest-AttachVolumeShelveTestJSON-2071262142 None] Lock "cinder-quobyte-23e54da6-16be-4004-8d4f-35dc6a54ec2b" released by "delete_volume" :: held 0.795s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:11 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-999b10b5-b7c9-4c3a-b178-85073b108a0e tempest-AttachVolumeShelveTestJSON-2071262142 None] Created reservations ['4de29eb8-882c-44cc-b1fc-7cd5f3fc254e', '0cd99b76-b82b-41f3-99c3-fafc2cb1659b', 'd048d74c-b38c-4248-85d2-3a98a0279165', '74814ee5-36c1-414e-bb68-752ffc7be347'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-999b10b5-b7c9-4c3a-b178-85073b108a0e tempest-AttachVolumeShelveTestJSON-2071262142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-999b10b5-b7c9-4c3a-b178-85073b108a0e tempest-AttachVolumeShelveTestJSON-2071262142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-999b10b5-b7c9-4c3a-b178-85073b108a0e tempest-AttachVolumeShelveTestJSON-2071262142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-999b10b5-b7c9-4c3a-b178-85073b108a0e tempest-AttachVolumeShelveTestJSON-2071262142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-999b10b5-b7c9-4c3a-b178-85073b108a0e tempest-AttachVolumeShelveTestJSON-2071262142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-999b10b5-b7c9-4c3a-b178-85073b108a0e tempest-AttachVolumeShelveTestJSON-2071262142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:12 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:55:12 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-999b10b5-b7c9-4c3a-b178-85073b108a0e tempest-AttachVolumeShelveTestJSON-2071262142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.479s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-999b10b5-b7c9-4c3a-b178-85073b108a0e tempest-AttachVolumeShelveTestJSON-2071262142 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:55:12 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:12 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-999b10b5-b7c9-4c3a-b178-85073b108a0e tempest-AttachVolumeShelveTestJSON-2071262142 None] Deleted volume successfully. Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Flow 'volume_create_manager' (fb55019b-adc8-4ee2-b163-db904d89600a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c509d740-7839-4f7f-890f-e9d6c0cbce27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-999b10b5-b7c9-4c3a-b178-85073b108a0e tempest-AttachVolumeShelveTestJSON-2071262142 None] Lock "cinder-23e54da6-16be-4004-8d4f-35dc6a54ec2b-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c509d740-7839-4f7f-890f-e9d6c0cbce27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-100883750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8219b81-29e8-4d4e-9059-cf53a1c21f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac98e88b2484d91b26976d2b4e1fd6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:13Z,use_quota=True,user_id='af7b045b02a84c069b6bb5877f41bbfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22490234-c091-480b-ad80-7ee4c1f28975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22490234-c091-480b-ad80-7ee4c1f28975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5962da2c-be96-4712-871e-9cdb6cdbf6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5962da2c-be96-4712-871e-9cdb6cdbf6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8219b81-29e8-4d4e-9059-cf53a1c21f21', 'volume_name': 'volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f665c4b5-fe91-4b3d-b608-f3242f0cf545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f665c4b5-fe91-4b3d-b608-f3242f0cf545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26beaf36-b3b1-414f-9ba1-f37ad3d9f86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:12 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Volume f8219b81-29e8-4d4e-9059-cf53a1c21f21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21', 'volume_size': 1} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-100883750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8219b81-29e8-4d4e-9059-cf53a1c21f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac98e88b2484d91b26976d2b4e1fd6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:13Z,use_quota=True,user_id='af7b045b02a84c069b6bb5877f41bbfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Creating volume f8219b81-29e8-4d4e-9059-cf53a1c21f21 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:55:12 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:55:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:12 devstack sudo[96562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21 1073741824 Sep 04 15:55:12 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Flow 'volume_create_manager' (c3fe5c22-c367-41d6-8761-d22c9aaa8762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd34cc8-be38-4722-a44d-dc97cccaed34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd34cc8-be38-4722-a44d-dc97cccaed34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1574875546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f775eb0a-f934-4bc8-9c74-825e03f5e711,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6f2e54c5ba0246fda3731a27c858e1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:13Z,use_quota=True,user_id='6f034b783b3a466b88617419a40b4b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d38209f8-22b5-4e5b-b331-d540b997a670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d38209f8-22b5-4e5b-b331-d540b997a670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc7a1d6-b4ad-4997-a6e4-f69ea8188b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc7a1d6-b4ad-4997-a6e4-f69ea8188b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f775eb0a-f934-4bc8-9c74-825e03f5e711', 'volume_name': 'volume-f775eb0a-f934-4bc8-9c74-825e03f5e711', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac84246-775f-4343-993e-24c46f5005ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac84246-775f-4343-993e-24c46f5005ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (215a0934-0964-4930-9ab0-17d56bb1fbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:13 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Volume f775eb0a-f934-4bc8-9c74-825e03f5e711: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f775eb0a-f934-4bc8-9c74-825e03f5e711', 'volume_size': 1} Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:13 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21 1073741824" returned: 0 in 0.794s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:13 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21 Sep 04 15:55:13 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:13 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21" returned: 0 in 0.279s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.597s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1574875546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f775eb0a-f934-4bc8-9c74-825e03f5e711,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6f2e54c5ba0246fda3731a27c858e1f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:13Z,use_quota=True,user_id='6f034b783b3a466b88617419a40b4b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Creating volume f775eb0a-f934-4bc8-9c74-825e03f5e711 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:55:13 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f775eb0a-f934-4bc8-9c74-825e03f5e711 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26beaf36-b3b1-414f-9ba1-f37ad3d9f86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcab9161-4087-4e44-ae62-cfb4bf7066c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:13 devstack sudo[96570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f775eb0a-f934-4bc8-9c74-825e03f5e711 1073741824 Sep 04 15:55:13 devstack sudo[96570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:13 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Volume volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21 (f8219b81-29e8-4d4e-9059-cf53a1c21f21): created successfully Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcab9161-4087-4e44-ae62-cfb4bf7066c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Flow 'volume_create_manager' (fb55019b-adc8-4ee2-b163-db904d89600a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:13 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-9be8bab7-464c-4268-80e2-e6bebe146c73 tempest-VolumesSnapshotTestJSON-1655945923 None] Created volume successfully. Sep 04 15:55:14 devstack sudo[96570]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f775eb0a-f934-4bc8-9c74-825e03f5e711 1073741824" returned: 0 in 0.517s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f775eb0a-f934-4bc8-9c74-825e03f5e711 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:14 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f775eb0a-f934-4bc8-9c74-825e03f5e711 Sep 04 15:55:14 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:14 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-2861d110-b6ee-4d7d-abf7-e00d73370fed tempest-GroupSnapshotsV319Test-184294332 None] Group tempest-GroupSnapshotsV319Test-Group-1136632702: creating Sep 04 15:55:14 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-2861d110-b6ee-4d7d-abf7-e00d73370fed tempest-GroupSnapshotsV319Test-184294332 None] Group tempest-GroupSnapshotsV319Test-Group-1136632702: created successfully Sep 04 15:55:14 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-2861d110-b6ee-4d7d-abf7-e00d73370fed tempest-GroupSnapshotsV319Test-184294332 None] Create group completed successfully. Sep 04 15:55:14 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f775eb0a-f934-4bc8-9c74-825e03f5e711" returned: 0 in 0.287s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:55:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (215a0934-0964-4930-9ab0-17d56bb1fbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f775eb0a-f934-4bc8-9c74-825e03f5e711', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f084fba-e080-44fb-b17c-fdc0ab284e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:14 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Volume volume-f775eb0a-f934-4bc8-9c74-825e03f5e711 (f775eb0a-f934-4bc8-9c74-825e03f5e711): created successfully Sep 04 15:55:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f084fba-e080-44fb-b17c-fdc0ab284e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Flow 'volume_create_manager' (c3fe5c22-c367-41d6-8761-d22c9aaa8762) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:14 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-a0a56576-662b-4b1e-bd04-9aa1e8e12e1c req-9bfa5885-551f-4262-a441-54ab3ce8d88f tempest-VolumesGetTestJSON-279927482 None] Created volume successfully. Sep 04 15:55:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-494b16d6-12f7-4c24-8612-36285a2629b5 tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-494b16d6-12f7-4c24-8612-36285a2629b5 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-494b16d6-12f7-4c24-8612-36285a2629b5 tempest-VolumesSnapshotTestJSON-1655945923 None] Creating offline snapshot 99f9af76-4bfe-47d0-ad94-7aa628d14e87 of volume f8219b81-29e8-4d4e-9059-cf53a1c21f21 {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:55:14 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef9359a-330b-49e3-b907-0e0cb465a6b3]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-494b16d6-12f7-4c24-8612-36285a2629b5 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:14 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21 Sep 04 15:55:14 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:15 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-494b16d6-12f7-4c24-8612-36285a2629b5 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21" returned: 0 in 0.416s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-494b16d6-12f7-4c24-8612-36285a2629b5 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.99f9af76-4bfe-47d0-ad94-7aa628d14e87 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:15 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.99f9af76-4bfe-47d0-ad94-7aa628d14e87 1G Sep 04 15:55:15 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:15 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-778ac097-582e-4ebb-9322-8ee13b0f6bc3 req-73c22114-4a99-45b2-9260-c037bff26633 tempest-VolumesGetTestJSON-279927482 None] Acquiring lock "cinder-f775eb0a-f934-4bc8-9c74-825e03f5e711-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:15 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-778ac097-582e-4ebb-9322-8ee13b0f6bc3 req-73c22114-4a99-45b2-9260-c037bff26633 tempest-VolumesGetTestJSON-279927482 None] Lock "cinder-f775eb0a-f934-4bc8-9c74-825e03f5e711-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:15 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-778ac097-582e-4ebb-9322-8ee13b0f6bc3 req-73c22114-4a99-45b2-9260-c037bff26633 tempest-VolumesGetTestJSON-279927482 None] Acquiring lock "cinder-quobyte-f775eb0a-f934-4bc8-9c74-825e03f5e711" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:15 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:15 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-778ac097-582e-4ebb-9322-8ee13b0f6bc3 req-73c22114-4a99-45b2-9260-c037bff26633 tempest-VolumesGetTestJSON-279927482 None] Lock "cinder-quobyte-f775eb0a-f934-4bc8-9c74-825e03f5e711" acquired by "delete_volume" :: waited 0.025s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-494b16d6-12f7-4c24-8612-36285a2629b5 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.99f9af76-4bfe-47d0-ad94-7aa628d14e87 1G" returned: 0 in 0.508s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-494b16d6-12f7-4c24-8612-36285a2629b5 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.99f9af76-4bfe-47d0-ad94-7aa628d14e87 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:15 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13ee12d-424a-4b0c-8f6b-c2f056818661]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-778ac097-582e-4ebb-9322-8ee13b0f6bc3 req-73c22114-4a99-45b2-9260-c037bff26633 tempest-VolumesGetTestJSON-279927482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f775eb0a-f934-4bc8-9c74-825e03f5e711 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:15 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.99f9af76-4bfe-47d0-ad94-7aa628d14e87 Sep 04 15:55:15 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:15 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f775eb0a-f934-4bc8-9c74-825e03f5e711 Sep 04 15:55:15 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:16 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-494b16d6-12f7-4c24-8612-36285a2629b5 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.99f9af76-4bfe-47d0-ad94-7aa628d14e87" returned: 0 in 0.408s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:16 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-494b16d6-12f7-4c24-8612-36285a2629b5 tempest-VolumesSnapshotTestJSON-1655945923 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.99f9af76-4bfe-47d0-ad94-7aa628d14e87 is being set with open permissions: ugo+rw Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-494b16d6-12f7-4c24-8612-36285a2629b5 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.99f9af76-4bfe-47d0-ad94-7aa628d14e87 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:16 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.99f9af76-4bfe-47d0-ad94-7aa628d14e87 Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:55:16 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:16 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Flow 'volume_create_manager' (eac3e364-dc22-4a1f-91d4-0ada7ec2ea29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83cbb542-5570-45cd-a100-74bb4edf00d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-778ac097-582e-4ebb-9322-8ee13b0f6bc3 req-73c22114-4a99-45b2-9260-c037bff26633 tempest-VolumesGetTestJSON-279927482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f775eb0a-f934-4bc8-9c74-825e03f5e711" returned: 0 in 0.487s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-778ac097-582e-4ebb-9322-8ee13b0f6bc3 req-73c22114-4a99-45b2-9260-c037bff26633 tempest-VolumesGetTestJSON-279927482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f775eb0a-f934-4bc8-9c74-825e03f5e711 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83cbb542-5570-45cd-a100-74bb4edf00d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-844400118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f31a777b-924d-4ede-a5c1-a1b666adf9f5,host='devstack@QuobyteHD#QuobyteHD',id=4619da82-234a-430f-b544-799d358ffe37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d56055c8cb455c87b4db4ec8c7de95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:16Z,use_quota=True,user_id='af3abd0c14064f848c67c9c9750839de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0eebbcb5-ddef-423a-9f66-9cb268eb87c6),volume_type_id=0eebbcb5-ddef-423a-9f66-9cb268eb87c6)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688ca947-673b-4e12-853e-aa9a1dbac363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688ca947-673b-4e12-853e-aa9a1dbac363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:16 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f775eb0a-f934-4bc8-9c74-825e03f5e711 Sep 04 15:55:16 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886f93bc-421d-4887-90de-e2d67cb396eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886f93bc-421d-4887-90de-e2d67cb396eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4619da82-234a-430f-b544-799d358ffe37', 'volume_name': 'volume-4619da82-234a-430f-b544-799d358ffe37', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f8e017-86b3-4589-8cbe-59a1cf22f84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f8e017-86b3-4589-8cbe-59a1cf22f84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe3898c9-3535-4454-b253-395fbf648f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:16 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Volume 4619da82-234a-430f-b544-799d358ffe37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4619da82-234a-430f-b544-799d358ffe37', 'volume_size': 1} Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:16 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-494b16d6-12f7-4c24-8612-36285a2629b5 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.99f9af76-4bfe-47d0-ad94-7aa628d14e87" returned: 0 in 0.348s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-494b16d6-12f7-4c24-8612-36285a2629b5 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:16 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.info Sep 04 15:55:16 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:16 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-778ac097-582e-4ebb-9322-8ee13b0f6bc3 req-73c22114-4a99-45b2-9260-c037bff26633 tempest-VolumesGetTestJSON-279927482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f775eb0a-f934-4bc8-9c74-825e03f5e711" returned: 0 in 0.343s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-778ac097-582e-4ebb-9322-8ee13b0f6bc3 req-73c22114-4a99-45b2-9260-c037bff26633 tempest-VolumesGetTestJSON-279927482 None] Lock "cinder-quobyte-f775eb0a-f934-4bc8-9c74-825e03f5e711" released by "delete_volume" :: held 0.897s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG cinder.quota [req-778ac097-582e-4ebb-9322-8ee13b0f6bc3 req-73c22114-4a99-45b2-9260-c037bff26633 tempest-VolumesGetTestJSON-279927482 None] Created reservations ['b2328f3d-09bd-49db-a5ec-b3274f33a0ab', 'c2ed5fd0-72fd-464c-b719-858d8189b027', 'f39d70eb-31df-45a4-a450-2ea27560df94', '87669376-d20a-46ea-a590-45a3aeefc975'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-778ac097-582e-4ebb-9322-8ee13b0f6bc3 req-73c22114-4a99-45b2-9260-c037bff26633 tempest-VolumesGetTestJSON-279927482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-778ac097-582e-4ebb-9322-8ee13b0f6bc3 req-73c22114-4a99-45b2-9260-c037bff26633 tempest-VolumesGetTestJSON-279927482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [req-778ac097-582e-4ebb-9322-8ee13b0f6bc3 req-73c22114-4a99-45b2-9260-c037bff26633 tempest-VolumesGetTestJSON-279927482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [req-778ac097-582e-4ebb-9322-8ee13b0f6bc3 req-73c22114-4a99-45b2-9260-c037bff26633 tempest-VolumesGetTestJSON-279927482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-778ac097-582e-4ebb-9322-8ee13b0f6bc3 req-73c22114-4a99-45b2-9260-c037bff26633 tempest-VolumesGetTestJSON-279927482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-778ac097-582e-4ebb-9322-8ee13b0f6bc3 req-73c22114-4a99-45b2-9260-c037bff26633 tempest-VolumesGetTestJSON-279927482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:16 devstack sudo[96609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:55:16 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:16 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-494b16d6-12f7-4c24-8612-36285a2629b5 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.info" returned: 0 in 0.346s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:16 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-494b16d6-12f7-4c24-8612-36285a2629b5 tempest-VolumesSnapshotTestJSON-1655945923 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.info is being set with open permissions: ugo+rw Sep 04 15:55:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-494b16d6-12f7-4c24-8612-36285a2629b5 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:16 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.info Sep 04 15:55:16 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:17 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-778ac097-582e-4ebb-9322-8ee13b0f6bc3 req-73c22114-4a99-45b2-9260-c037bff26633 tempest-VolumesGetTestJSON-279927482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.267s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:17 devstack cinder-volume[87490]: DEBUG cinder.manager [req-778ac097-582e-4ebb-9322-8ee13b0f6bc3 req-73c22114-4a99-45b2-9260-c037bff26633 tempest-VolumesGetTestJSON-279927482 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:55:17 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-778ac097-582e-4ebb-9322-8ee13b0f6bc3 req-73c22114-4a99-45b2-9260-c037bff26633 tempest-VolumesGetTestJSON-279927482 None] Deleted volume successfully. Sep 04 15:55:17 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-778ac097-582e-4ebb-9322-8ee13b0f6bc3 req-73c22114-4a99-45b2-9260-c037bff26633 tempest-VolumesGetTestJSON-279927482 None] Lock "cinder-f775eb0a-f934-4bc8-9c74-825e03f5e711-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:17 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-494b16d6-12f7-4c24-8612-36285a2629b5 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.info" returned: 0 in 0.304s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-494b16d6-12f7-4c24-8612-36285a2629b5 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.423s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.858s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:17 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f31a777b-924d-4ede-a5c1-a1b666adf9f5,created_at=2026-09-04T13:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-844400118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f31a777b-924d-4ede-a5c1-a1b666adf9f5,host='devstack@QuobyteHD#QuobyteHD',id=4619da82-234a-430f-b544-799d358ffe37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d56055c8cb455c87b4db4ec8c7de95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:16Z,use_quota=True,user_id='af3abd0c14064f848c67c9c9750839de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0eebbcb5-ddef-423a-9f66-9cb268eb87c6),volume_type_id=0eebbcb5-ddef-423a-9f66-9cb268eb87c6)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:55:17 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Creating volume 4619da82-234a-430f-b544-799d358ffe37 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:55:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:17 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:55:17 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:55:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:17 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:55:17 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:55:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:17 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37 1073741824 Sep 04 15:55:17 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:17 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-494b16d6-12f7-4c24-8612-36285a2629b5 tempest-VolumesSnapshotTestJSON-1655945923 None] Create snapshot completed successfully Sep 04 15:55:17 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37 1073741824" returned: 0 in 0.619s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:17 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37 Sep 04 15:55:17 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:18 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37" returned: 0 in 0.296s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe3898c9-3535-4454-b253-395fbf648f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4619da82-234a-430f-b544-799d358ffe37', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83d41e53-95fd-4d97-a7be-b1b3105147d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:18 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Volume volume-4619da82-234a-430f-b544-799d358ffe37 (4619da82-234a-430f-b544-799d358ffe37): created successfully Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83d41e53-95fd-4d97-a7be-b1b3105147d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Flow 'volume_create_manager' (eac3e364-dc22-4a1f-91d4-0ada7ec2ea29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:18 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-4187b02e-65c9-47dc-9bf2-dde766b858ca tempest-GroupSnapshotsV319Test-184294332 None] Created volume successfully. Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Flow 'volume_create_manager' (c1f97685-7093-45af-91dd-4a2b8ed165cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024a9230-f9bc-42c5-b348-7d5233591d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024a9230-f9bc-42c5-b348-7d5233591d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-6529792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585dfc5b-4711-45d5-8b5f-3d16e805be02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac98e88b2484d91b26976d2b4e1fd6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=99f9af76-4bfe-47d0-ad94-7aa628d14e87,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:19Z,use_quota=True,user_id='af7b045b02a84c069b6bb5877f41bbfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a9954e5-1b0b-4560-a5bd-4c2455c8f396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a9954e5-1b0b-4560-a5bd-4c2455c8f396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ab49dd8-8f0c-45ba-a8d9-1c35c7ecf9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ab49dd8-8f0c-45ba-a8d9-1c35c7ecf9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '585dfc5b-4711-45d5-8b5f-3d16e805be02', 'volume_name': 'volume-585dfc5b-4711-45d5-8b5f-3d16e805be02', 'volume_size': 1, 'snapshot_id': '99f9af76-4bfe-47d0-ad94-7aa628d14e87'}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a71ef8d-b51b-4ecf-91f8-f6ed4bcfeba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a71ef8d-b51b-4ecf-91f8-f6ed4bcfeba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca140f84-a112-4ec7-b007-fd063299dc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:18 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Volume 585dfc5b-4711-45d5-8b5f-3d16e805be02: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-585dfc5b-4711-45d5-8b5f-3d16e805be02', 'volume_size': 1, 'snapshot_id': '99f9af76-4bfe-47d0-ad94-7aa628d14e87'} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "cinder-quobyte-99f9af76-4bfe-47d0-ad94-7aa628d14e87-585dfc5b-4711-45d5-8b5f-3d16e805be02" by "_create_volume_from_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-99f9af76-4bfe-47d0-ad94-7aa628d14e87-585dfc5b-4711-45d5-8b5f-3d16e805be02" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Creating volume 585dfc5b-4711-45d5-8b5f-3d16e805be02 from snapshot 99f9af76-4bfe-47d0-ad94-7aa628d14e87 {{(pid=87490) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "cinder-quobyte-585dfc5b-4711-45d5-8b5f-3d16e805be02" by "_copy_volume_from_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-585dfc5b-4711-45d5-8b5f-3d16e805be02" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] snapshot: 99f9af76-4bfe-47d0-ad94-7aa628d14e87, volume: 585dfc5b-4711-45d5-8b5f-3d16e805be02, {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 15:55:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:55:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:55:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:19 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b683474-6f63-4613-8a1f-c5a9c86ac455]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.99f9af76-4bfe-47d0-ad94-7aa628d14e87 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:19 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-6705f848-9616-43e5-ae89-c758f4fb4605 tempest-GroupSnapshotsV319Test-184294332 None] GroupSnapshot b22e40e4-5b07-4705-864a-67c3545dadd1: creating. Sep 04 15:55:19 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.99f9af76-4bfe-47d0-ad94-7aa628d14e87 Sep 04 15:55:19 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6705f848-9616-43e5-ae89-c758f4fb4605 tempest-GroupSnapshotsV319Test-184294332 None] Group snapshot b22e40e4-5b07-4705-864a-67c3545dadd1: creating. {{(pid=87490) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 04 15:55:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6705f848-9616-43e5-ae89-c758f4fb4605 tempest-GroupSnapshotsV319Test-184294332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:19 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.99f9af76-4bfe-47d0-ad94-7aa628d14e87" returned: 0 in 0.451s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:55:19 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d89c23-8033-445b-98cf-c462d83b8c79]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:19 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21 Sep 04 15:55:19 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:19 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21" returned: 0 in 0.410s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21 {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 15:55:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Creating direct copy from snapshot {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 15:55:19 devstack cinder-volume[87490]: DEBUG cinder.utils [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Path /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-585dfc5b-4711-45d5-8b5f-3d16e805be02 not found in is_blk_device check {{(pid=87490) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 15:55:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-585dfc5b-4711-45d5-8b5f-3d16e805be02 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:19 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-585dfc5b-4711-45d5-8b5f-3d16e805be02 Sep 04 15:55:19 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:23 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:55:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Flow 'volume_create_manager' (a2a4e1b4-0aa1-4ac3-949e-7c63a6c7352c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af37b62c-bc17-494b-b9f6-73c527d5e67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af37b62c-bc17-494b-b9f6-73c527d5e67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1166305788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4b7a736-b9dd-40cc-a2ac-33fc437802ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2209d8723d22416eb1738ca2bd7ef7a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:23Z,use_quota=True,user_id='48f4e13cc7f247c4bf69f05b8bf388e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e0a608-3946-40a9-8504-137641aea365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e0a608-3946-40a9-8504-137641aea365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (540e1580-8ab8-4794-a863-3c577e82c116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (540e1580-8ab8-4794-a863-3c577e82c116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4b7a736-b9dd-40cc-a2ac-33fc437802ab', 'volume_name': 'volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b7d5256-887c-4bd5-8add-20eaddfda7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b7d5256-887c-4bd5-8add-20eaddfda7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9736cc69-14a7-429a-96af-e9f39108b028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:23 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Volume a4b7a736-b9dd-40cc-a2ac-33fc437802ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab', 'volume_size': 1} Sep 04 15:55:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:24 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-5c2900dc-f365-42b5-882c-7bfd45e5eaa1 tempest-GroupSnapshotsTest-720540587 None] Group tempest-GroupSnapshotsTest-Group-1170420143: creating Sep 04 15:55:24 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-5c2900dc-f365-42b5-882c-7bfd45e5eaa1 tempest-GroupSnapshotsTest-720540587 None] Group tempest-GroupSnapshotsTest-Group-1170420143: created successfully Sep 04 15:55:24 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-5c2900dc-f365-42b5-882c-7bfd45e5eaa1 tempest-GroupSnapshotsTest-720540587 None] Create group completed successfully. Sep 04 15:55:25 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-585dfc5b-4711-45d5-8b5f-3d16e805be02" returned: 0 in 5.176s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21, size 1024.00 MB, duration 5.18 sec, destination /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-585dfc5b-4711-45d5-8b5f-3d16e805be02 {{(pid=87490) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 15:55:25 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Converted 1024.00 MB image at 197.78 MB/s Sep 04 15:55:25 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-585dfc5b-4711-45d5-8b5f-3d16e805be02 is being set with open permissions: ugo+rw Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-585dfc5b-4711-45d5-8b5f-3d16e805be02 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:25 devstack sudo[96779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-585dfc5b-4711-45d5-8b5f-3d16e805be02 Sep 04 15:55:25 devstack sudo[96779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:25 devstack sudo[96779]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-585dfc5b-4711-45d5-8b5f-3d16e805be02" returned: 0 in 0.248s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-585dfc5b-4711-45d5-8b5f-3d16e805be02" released by "_copy_volume_from_snapshot" :: held 6.454s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-99f9af76-4bfe-47d0-ad94-7aa628d14e87-585dfc5b-4711-45d5-8b5f-3d16e805be02" released by "_create_volume_from_snapshot" :: held 6.530s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.547s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6705f848-9616-43e5-ae89-c758f4fb4605 tempest-GroupSnapshotsV319Test-184294332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.178s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-6705f848-9616-43e5-ae89-c758f4fb4605 tempest-GroupSnapshotsV319Test-184294332 None] Creating offline snapshot 214245ef-5393-44c1-be26-52cf6ee297c7 of volume 4619da82-234a-430f-b544-799d358ffe37 {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca140f84-a112-4ec7-b007-fd063299dc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-585dfc5b-4711-45d5-8b5f-3d16e805be02', 'volume_size': 1, 'snapshot_id': '99f9af76-4bfe-47d0-ad94-7aa628d14e87'}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8ec060-0959-4980-b233-f03353f812f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[5802095a-f8cf-4679-a1cb-b1a3a5973829]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6705f848-9616-43e5-ae89-c758f4fb4605 tempest-GroupSnapshotsV319Test-184294332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:25 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Volume volume-585dfc5b-4711-45d5-8b5f-3d16e805be02 (585dfc5b-4711-45d5-8b5f-3d16e805be02): created successfully Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8ec060-0959-4980-b233-f03353f812f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Flow 'volume_create_manager' (c1f97685-7093-45af-91dd-4a2b8ed165cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:25 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-89ca4b11-a707-430f-a3d2-b6aba8a85aa2 tempest-VolumesSnapshotTestJSON-1655945923 None] Created volume successfully. Sep 04 15:55:25 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37 Sep 04 15:55:25 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Flow 'volume_create_manager' (867468ee-3298-4151-88b4-71a174f0b9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081192c7-895d-49aa-86f9-e752a0a7e1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081192c7-895d-49aa-86f9-e752a0a7e1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1027145313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6384e3b1-683d-467f-979b-8dbd7ab54c40,host='devstack@QuobyteHD#QuobyteHD',id=da4415ad-d85c-496d-a0a1-a7b39f14a1a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf6533eb8f14487aa6ff16635e4f8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:26Z,use_quota=True,user_id='5f124db038e44042953cac40ebd39681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d75d8aa8-d2a1-4c85-a155-e1465c238087),volume_type_id=d75d8aa8-d2a1-4c85-a155-e1465c238087)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3a507f-1feb-4eaf-a806-bf05df20e6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3a507f-1feb-4eaf-a806-bf05df20e6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de521fcf-da1f-4753-8b34-095e297cb01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de521fcf-da1f-4753-8b34-095e297cb01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da4415ad-d85c-496d-a0a1-a7b39f14a1a0', 'volume_name': 'volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6840f61b-a3c8-4f56-aef1-1904b44f6095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6840f61b-a3c8-4f56-aef1-1904b44f6095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c28afc0a-e4e3-4273-990b-b91422f15c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:25 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Volume da4415ad-d85c-496d-a0a1-a7b39f14a1a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0', 'volume_size': 1} Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:25 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6705f848-9616-43e5-ae89-c758f4fb4605 tempest-GroupSnapshotsV319Test-184294332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37" returned: 0 in 0.389s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6705f848-9616-43e5-ae89-c758f4fb4605 tempest-GroupSnapshotsV319Test-184294332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37.214245ef-5393-44c1-be26-52cf6ee297c7 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:25 devstack sudo[96787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37.214245ef-5393-44c1-be26-52cf6ee297c7 1G Sep 04 15:55:25 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:26 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6705f848-9616-43e5-ae89-c758f4fb4605 tempest-GroupSnapshotsV319Test-184294332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37.214245ef-5393-44c1-be26-52cf6ee297c7 1G" returned: 0 in 0.377s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6705f848-9616-43e5-ae89-c758f4fb4605 tempest-GroupSnapshotsV319Test-184294332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4619da82-234a-430f-b544-799d358ffe37 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37.214245ef-5393-44c1-be26-52cf6ee297c7 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:26 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4619da82-234a-430f-b544-799d358ffe37 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37.214245ef-5393-44c1-be26-52cf6ee297c7 Sep 04 15:55:26 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2934f963-452e-4a0a-a349-747f8430fa0c tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "cinder-585dfc5b-4711-45d5-8b5f-3d16e805be02-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2934f963-452e-4a0a-a349-747f8430fa0c tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-585dfc5b-4711-45d5-8b5f-3d16e805be02-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:26 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6705f848-9616-43e5-ae89-c758f4fb4605 tempest-GroupSnapshotsV319Test-184294332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4619da82-234a-430f-b544-799d358ffe37 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37.214245ef-5393-44c1-be26-52cf6ee297c7" returned: 0 in 0.329s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:26 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-6705f848-9616-43e5-ae89-c758f4fb4605 tempest-GroupSnapshotsV319Test-184294332 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37.214245ef-5393-44c1-be26-52cf6ee297c7 is being set with open permissions: ugo+rw: NotImplementedError Sep 04 15:55:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6705f848-9616-43e5-ae89-c758f4fb4605 tempest-GroupSnapshotsV319Test-184294332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37.214245ef-5393-44c1-be26-52cf6ee297c7 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2934f963-452e-4a0a-a349-747f8430fa0c tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "cinder-quobyte-585dfc5b-4711-45d5-8b5f-3d16e805be02" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:26 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37.214245ef-5393-44c1-be26-52cf6ee297c7 Sep 04 15:55:26 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2934f963-452e-4a0a-a349-747f8430fa0c tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-585dfc5b-4711-45d5-8b5f-3d16e805be02" acquired by "delete_volume" :: waited 0.020s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:26 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[8649147a-5d2b-4b78-b89d-c88e37dec892]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2934f963-452e-4a0a-a349-747f8430fa0c tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-585dfc5b-4711-45d5-8b5f-3d16e805be02 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:26 devstack sudo[96800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-585dfc5b-4711-45d5-8b5f-3d16e805be02 Sep 04 15:55:26 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:26 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6705f848-9616-43e5-ae89-c758f4fb4605 tempest-GroupSnapshotsV319Test-184294332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37.214245ef-5393-44c1-be26-52cf6ee297c7" returned: 0 in 0.252s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6705f848-9616-43e5-ae89-c758f4fb4605 tempest-GroupSnapshotsV319Test-184294332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:26 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37.info Sep 04 15:55:26 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:27 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2934f963-452e-4a0a-a349-747f8430fa0c tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-585dfc5b-4711-45d5-8b5f-3d16e805be02" returned: 0 in 0.393s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2934f963-452e-4a0a-a349-747f8430fa0c tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-585dfc5b-4711-45d5-8b5f-3d16e805be02 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:27 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-585dfc5b-4711-45d5-8b5f-3d16e805be02 Sep 04 15:55:27 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:27 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6705f848-9616-43e5-ae89-c758f4fb4605 tempest-GroupSnapshotsV319Test-184294332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37.info" returned: 0 in 0.254s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:27 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-6705f848-9616-43e5-ae89-c758f4fb4605 tempest-GroupSnapshotsV319Test-184294332 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6705f848-9616-43e5-ae89-c758f4fb4605 tempest-GroupSnapshotsV319Test-184294332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:27 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37.info Sep 04 15:55:27 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:27 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2934f963-452e-4a0a-a349-747f8430fa0c tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-585dfc5b-4711-45d5-8b5f-3d16e805be02" returned: 0 in 0.240s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2934f963-452e-4a0a-a349-747f8430fa0c tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-585dfc5b-4711-45d5-8b5f-3d16e805be02" released by "delete_volume" :: held 0.669s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-2934f963-452e-4a0a-a349-747f8430fa0c tempest-VolumesSnapshotTestJSON-1655945923 None] Created reservations ['3f9c7e1e-fa85-4956-b916-4754804de58a', '84fbdb2c-647e-4096-94c0-b0883468b5dd', '6540c613-5d9f-4c41-9635-0d1fccd229de', '60bcf125-19c1-48a5-9f98-d6b407220032'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:55:27 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6705f848-9616-43e5-ae89-c758f4fb4605 tempest-GroupSnapshotsV319Test-184294332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37.info" returned: 0 in 0.245s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6705f848-9616-43e5-ae89-c758f4fb4605 tempest-GroupSnapshotsV319Test-184294332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.949s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.991s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1166305788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4b7a736-b9dd-40cc-a2ac-33fc437802ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2209d8723d22416eb1738ca2bd7ef7a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:23Z,use_quota=True,user_id='48f4e13cc7f247c4bf69f05b8bf388e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Creating volume a4b7a736-b9dd-40cc-a2ac-33fc437802ab {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:55:27 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:27 devstack sudo[96815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab 1073741824 Sep 04 15:55:27 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2934f963-452e-4a0a-a349-747f8430fa0c tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2934f963-452e-4a0a-a349-747f8430fa0c tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2934f963-452e-4a0a-a349-747f8430fa0c tempest-VolumesSnapshotTestJSON-1655945923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2934f963-452e-4a0a-a349-747f8430fa0c tempest-VolumesSnapshotTestJSON-1655945923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2934f963-452e-4a0a-a349-747f8430fa0c tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2934f963-452e-4a0a-a349-747f8430fa0c tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:27 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:55:27 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:27 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-6705f848-9616-43e5-ae89-c758f4fb4605 tempest-GroupSnapshotsV319Test-184294332 None] group_snapshot b22e40e4-5b07-4705-864a-67c3545dadd1: created successfully Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-49608e55-4c36-4c05-9e1a-4838ac6451dd tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "cinder-99f9af76-4bfe-47d0-ad94-7aa628d14e87-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-49608e55-4c36-4c05-9e1a-4838ac6451dd tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-99f9af76-4bfe-47d0-ad94-7aa628d14e87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-49608e55-4c36-4c05-9e1a-4838ac6451dd tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "cinder-quobyte-f8219b81-29e8-4d4e-9059-cf53a1c21f21" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:27 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-49608e55-4c36-4c05-9e1a-4838ac6451dd tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-f8219b81-29e8-4d4e-9059-cf53a1c21f21" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-49608e55-4c36-4c05-9e1a-4838ac6451dd tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "cinder-quobyte-99f9af76-4bfe-47d0-ad94-7aa628d14e87" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2934f963-452e-4a0a-a349-747f8430fa0c tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.281s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-2934f963-452e-4a0a-a349-747f8430fa0c tempest-VolumesSnapshotTestJSON-1655945923 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:55:27 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-2934f963-452e-4a0a-a349-747f8430fa0c tempest-VolumesSnapshotTestJSON-1655945923 None] Deleted volume successfully. Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-49608e55-4c36-4c05-9e1a-4838ac6451dd tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-99f9af76-4bfe-47d0-ad94-7aa628d14e87" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-49608e55-4c36-4c05-9e1a-4838ac6451dd tempest-VolumesSnapshotTestJSON-1655945923 None] Deleting offline snapshot 99f9af76-4bfe-47d0-ad94-7aa628d14e87 of volume f8219b81-29e8-4d4e-9059-cf53a1c21f21 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-49608e55-4c36-4c05-9e1a-4838ac6451dd tempest-VolumesSnapshotTestJSON-1655945923 None] snapshot_file for this snap is: volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.99f9af76-4bfe-47d0-ad94-7aa628d14e87 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1e0659-c2f2-40c5-ae29-94ef771f18d7]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-49608e55-4c36-4c05-9e1a-4838ac6451dd tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.99f9af76-4bfe-47d0-ad94-7aa628d14e87 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2934f963-452e-4a0a-a349-747f8430fa0c tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-585dfc5b-4711-45d5-8b5f-3d16e805be02-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:27 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab 1073741824" returned: 0 in 0.538s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:27 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.99f9af76-4bfe-47d0-ad94-7aa628d14e87 Sep 04 15:55:27 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:28 devstack sudo[96827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab Sep 04 15:55:28 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:28 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-49608e55-4c36-4c05-9e1a-4838ac6451dd tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.99f9af76-4bfe-47d0-ad94-7aa628d14e87" returned: 0 in 0.407s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-49608e55-4c36-4c05-9e1a-4838ac6451dd tempest-VolumesSnapshotTestJSON-1655945923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70e387d-f8d5-4a8c-ba72-06a19a7fa500]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-49608e55-4c36-4c05-9e1a-4838ac6451dd tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:28 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab" returned: 0 in 0.310s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.557s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6384e3b1-683d-467f-979b-8dbd7ab54c40,created_at=2026-09-04T13:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1027145313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6384e3b1-683d-467f-979b-8dbd7ab54c40,host='devstack@QuobyteHD#QuobyteHD',id=da4415ad-d85c-496d-a0a1-a7b39f14a1a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf6533eb8f14487aa6ff16635e4f8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:26Z,use_quota=True,user_id='5f124db038e44042953cac40ebd39681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d75d8aa8-d2a1-4c85-a155-e1465c238087),volume_type_id=d75d8aa8-d2a1-4c85-a155-e1465c238087)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Creating volume da4415ad-d85c-496d-a0a1-a7b39f14a1a0 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:55:28 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9736cc69-14a7-429a-96af-e9f39108b028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:28 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0 1073741824 Sep 04 15:55:28 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25e05a0-1a29-403f-8e70-0516b8281126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:28 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Volume volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab (a4b7a736-b9dd-40cc-a2ac-33fc437802ab): created successfully Sep 04 15:55:28 devstack sudo[96833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21 Sep 04 15:55:28 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25e05a0-1a29-403f-8e70-0516b8281126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Flow 'volume_create_manager' (a2a4e1b4-0aa1-4ac3-949e-7c63a6c7352c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:28 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-faa67664-c2cf-4d3c-80dc-849916d7551f tempest-GroupSnapshotsV319Test-184294332 None] group_snapshot b22e40e4-5b07-4705-864a-67c3545dadd1: deleting Sep 04 15:55:28 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-0539cb3c-1802-4753-8c43-8188a0c0fafa req-87f93515-3be9-4c96-b223-02708fba423f tempest-VolumesSnapshotsTestJSON-478555694 None] Created volume successfully. Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-faa67664-c2cf-4d3c-80dc-849916d7551f tempest-GroupSnapshotsV319Test-184294332 None] group_snapshot b22e40e4-5b07-4705-864a-67c3545dadd1: deleting {{(pid=87490) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-faa67664-c2cf-4d3c-80dc-849916d7551f tempest-GroupSnapshotsV319Test-184294332 None] Acquiring lock "cinder-quobyte-4619da82-234a-430f-b544-799d358ffe37" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-faa67664-c2cf-4d3c-80dc-849916d7551f tempest-GroupSnapshotsV319Test-184294332 None] Lock "cinder-quobyte-4619da82-234a-430f-b544-799d358ffe37" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-faa67664-c2cf-4d3c-80dc-849916d7551f tempest-GroupSnapshotsV319Test-184294332 None] Acquiring lock "cinder-quobyte-214245ef-5393-44c1-be26-52cf6ee297c7" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-faa67664-c2cf-4d3c-80dc-849916d7551f tempest-GroupSnapshotsV319Test-184294332 None] Lock "cinder-quobyte-214245ef-5393-44c1-be26-52cf6ee297c7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-faa67664-c2cf-4d3c-80dc-849916d7551f tempest-GroupSnapshotsV319Test-184294332 None] Deleting offline snapshot 214245ef-5393-44c1-be26-52cf6ee297c7 of volume 4619da82-234a-430f-b544-799d358ffe37 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-faa67664-c2cf-4d3c-80dc-849916d7551f tempest-GroupSnapshotsV319Test-184294332 None] snapshot_file for this snap is: volume-4619da82-234a-430f-b544-799d358ffe37.214245ef-5393-44c1-be26-52cf6ee297c7 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[405b9986-38d9-492b-9166-db954aa7cdce]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-faa67664-c2cf-4d3c-80dc-849916d7551f tempest-GroupSnapshotsV319Test-184294332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37.214245ef-5393-44c1-be26-52cf6ee297c7 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:28 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37.214245ef-5393-44c1-be26-52cf6ee297c7 Sep 04 15:55:28 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:28 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0 1073741824" returned: 0 in 0.515s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:28 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-49608e55-4c36-4c05-9e1a-4838ac6451dd tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21" returned: 0 in 0.587s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-49608e55-4c36-4c05-9e1a-4838ac6451dd tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.99f9af76-4bfe-47d0-ad94-7aa628d14e87 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:28 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.99f9af76-4bfe-47d0-ad94-7aa628d14e87 Sep 04 15:55:28 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:28 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0 Sep 04 15:55:28 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:28 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-faa67664-c2cf-4d3c-80dc-849916d7551f tempest-GroupSnapshotsV319Test-184294332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37.214245ef-5393-44c1-be26-52cf6ee297c7" returned: 0 in 0.391s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-faa67664-c2cf-4d3c-80dc-849916d7551f tempest-GroupSnapshotsV319Test-184294332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4619da82-234a-430f-b544-799d358ffe37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c5de5d-21b5-4eb8-91ac-489abf23ec75]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-faa67664-c2cf-4d3c-80dc-849916d7551f tempest-GroupSnapshotsV319Test-184294332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:29 devstack sudo[96854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37 Sep 04 15:55:29 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:29 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0" returned: 0 in 0.295s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:29 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:55:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:29 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=152,cinder:UPDATE=127,cinder:DELETE=11,cinder:INSERT=31 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:55:29 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c28afc0a-e4e3-4273-990b-b91422f15c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:29 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad654090-8169-4356-b152-89f4d9e5e51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:29 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=136,cinder:UPDATE=170,cinder:INSERT=37,cinder:DELETE=14 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:55:29 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Volume volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0 (da4415ad-d85c-496d-a0a1-a7b39f14a1a0): created successfully Sep 04 15:55:29 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad654090-8169-4356-b152-89f4d9e5e51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:29 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:29 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Flow 'volume_create_manager' (867468ee-3298-4151-88b4-71a174f0b9c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-49608e55-4c36-4c05-9e1a-4838ac6451dd tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.99f9af76-4bfe-47d0-ad94-7aa628d14e87" returned: 0 in 0.422s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-49608e55-4c36-4c05-9e1a-4838ac6451dd tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.99f9af76-4bfe-47d0-ad94-7aa628d14e87 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:29 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-54761dce-8e11-4f25-9fbc-e1cc95265851 tempest-GroupSnapshotsTest-720540587 None] Created volume successfully. Sep 04 15:55:29 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.99f9af76-4bfe-47d0-ad94-7aa628d14e87 Sep 04 15:55:29 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:29 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-faa67664-c2cf-4d3c-80dc-849916d7551f tempest-GroupSnapshotsV319Test-184294332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37" returned: 0 in 0.419s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-faa67664-c2cf-4d3c-80dc-849916d7551f tempest-GroupSnapshotsV319Test-184294332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37.214245ef-5393-44c1-be26-52cf6ee297c7 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:29 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37.214245ef-5393-44c1-be26-52cf6ee297c7 Sep 04 15:55:29 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-33411eba-c952-4c46-885e-d9eccb9a8dae req-f1230355-4c63-4881-81db-0aa0cb3a84c8 tempest-VolumesSnapshotsTestJSON-478555694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-33411eba-c952-4c46-885e-d9eccb9a8dae req-f1230355-4c63-4881-81db-0aa0cb3a84c8 tempest-VolumesSnapshotsTestJSON-478555694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:29 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [req-33411eba-c952-4c46-885e-d9eccb9a8dae req-f1230355-4c63-4881-81db-0aa0cb3a84c8 tempest-VolumesSnapshotsTestJSON-478555694 None] Creating offline snapshot b8f45760-a425-47a9-b335-c37b4dc474a2 of volume a4b7a736-b9dd-40cc-a2ac-33fc437802ab {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:55:29 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f9df0e-d162-42f0-b8e1-95a54dfaaf4c]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-33411eba-c952-4c46-885e-d9eccb9a8dae req-f1230355-4c63-4881-81db-0aa0cb3a84c8 tempest-VolumesSnapshotsTestJSON-478555694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:29 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-49608e55-4c36-4c05-9e1a-4838ac6451dd tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21.99f9af76-4bfe-47d0-ad94-7aa628d14e87" returned: 0 in 0.313s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:29 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-49608e55-4c36-4c05-9e1a-4838ac6451dd tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-99f9af76-4bfe-47d0-ad94-7aa628d14e87" released by "_delete_snapshot" :: held 1.857s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:29 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-49608e55-4c36-4c05-9e1a-4838ac6451dd tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-f8219b81-29e8-4d4e-9059-cf53a1c21f21" released by "delete_snapshot" :: held 1.898s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:29 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab Sep 04 15:55:29 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:29 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-49608e55-4c36-4c05-9e1a-4838ac6451dd tempest-VolumesSnapshotTestJSON-1655945923 None] Created reservations ['7b57699b-2ffd-4b07-97fb-cb985704cf72', '6fd3e1db-6b6e-41be-91fc-222b7ee8cda2', '3b0ef662-9e89-4ae6-9f3f-c6512b6414f1', '2bdf6548-ab04-4225-86f1-8c1371e803c3'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:55:29 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-49608e55-4c36-4c05-9e1a-4838ac6451dd tempest-VolumesSnapshotTestJSON-1655945923 None] Delete snapshot completed successfully. Sep 04 15:55:29 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-49608e55-4c36-4c05-9e1a-4838ac6451dd tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-99f9af76-4bfe-47d0-ad94-7aa628d14e87-delete_snapshot" released by "delete_snapshot" :: held 2.101s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:29 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-faa67664-c2cf-4d3c-80dc-849916d7551f tempest-GroupSnapshotsV319Test-184294332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37.214245ef-5393-44c1-be26-52cf6ee297c7" returned: 0 in 0.503s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-faa67664-c2cf-4d3c-80dc-849916d7551f tempest-GroupSnapshotsV319Test-184294332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37.214245ef-5393-44c1-be26-52cf6ee297c7 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:29 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37.214245ef-5393-44c1-be26-52cf6ee297c7 Sep 04 15:55:29 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:30 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cda8db3c-f5bf-4b68-b71b-1bd757e56af0 tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "cinder-f8219b81-29e8-4d4e-9059-cf53a1c21f21-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:30 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cda8db3c-f5bf-4b68-b71b-1bd757e56af0 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-f8219b81-29e8-4d4e-9059-cf53a1c21f21-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:30 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cda8db3c-f5bf-4b68-b71b-1bd757e56af0 tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "cinder-quobyte-f8219b81-29e8-4d4e-9059-cf53a1c21f21" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:30 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-33411eba-c952-4c46-885e-d9eccb9a8dae req-f1230355-4c63-4881-81db-0aa0cb3a84c8 tempest-VolumesSnapshotsTestJSON-478555694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab" returned: 0 in 0.505s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-33411eba-c952-4c46-885e-d9eccb9a8dae req-f1230355-4c63-4881-81db-0aa0cb3a84c8 tempest-VolumesSnapshotsTestJSON-478555694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab.b8f45760-a425-47a9-b335-c37b4dc474a2 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:30 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cda8db3c-f5bf-4b68-b71b-1bd757e56af0 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-f8219b81-29e8-4d4e-9059-cf53a1c21f21" acquired by "delete_volume" :: waited 0.038s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:30 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab.b8f45760-a425-47a9-b335-c37b4dc474a2 1G Sep 04 15:55:30 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:30 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd109a3d-c097-49c5-a520-ba16ed96ddf6]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cda8db3c-f5bf-4b68-b71b-1bd757e56af0 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:30 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-faa67664-c2cf-4d3c-80dc-849916d7551f tempest-GroupSnapshotsV319Test-184294332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37.214245ef-5393-44c1-be26-52cf6ee297c7" returned: 0 in 0.322s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:30 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-faa67664-c2cf-4d3c-80dc-849916d7551f tempest-GroupSnapshotsV319Test-184294332 None] Lock "cinder-quobyte-214245ef-5393-44c1-be26-52cf6ee297c7" released by "_delete_snapshot" :: held 1.731s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:30 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-faa67664-c2cf-4d3c-80dc-849916d7551f tempest-GroupSnapshotsV319Test-184294332 None] Lock "cinder-quobyte-4619da82-234a-430f-b544-799d358ffe37" released by "delete_snapshot" :: held 1.756s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:30 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21 Sep 04 15:55:30 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:30 devstack cinder-volume[87490]: WARNING cinder.quota [None req-faa67664-c2cf-4d3c-80dc-849916d7551f tempest-GroupSnapshotsV319Test-184294332 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-357541065 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-357541065, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:55:30 devstack cinder-volume[87490]: WARNING cinder.quota [None req-faa67664-c2cf-4d3c-80dc-849916d7551f tempest-GroupSnapshotsV319Test-184294332 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-357541065 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-357541065, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:55:30 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-faa67664-c2cf-4d3c-80dc-849916d7551f tempest-GroupSnapshotsV319Test-184294332 None] Created reservations ['36eaa866-cddf-4645-b76f-f7ad5204d894', '7f0eca3e-3f56-4e5a-96af-2fc9fbd1bc98', 'af27f01f-27e0-40b2-92a3-a76684528074', '4ca7174f-47ef-415c-9bb4-8ec593becc07'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:55:30 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-faa67664-c2cf-4d3c-80dc-849916d7551f tempest-GroupSnapshotsV319Test-184294332 None] group_snapshot b22e40e4-5b07-4705-864a-67c3545dadd1: deleted successfully Sep 04 15:55:30 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cda8db3c-f5bf-4b68-b71b-1bd757e56af0 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21" returned: 0 in 0.417s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cda8db3c-f5bf-4b68-b71b-1bd757e56af0 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:30 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:30 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21 Sep 04 15:55:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-33411eba-c952-4c46-885e-d9eccb9a8dae req-f1230355-4c63-4881-81db-0aa0cb3a84c8 tempest-VolumesSnapshotsTestJSON-478555694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab.b8f45760-a425-47a9-b335-c37b4dc474a2 1G" returned: 0 in 0.511s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:30 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-33411eba-c952-4c46-885e-d9eccb9a8dae req-f1230355-4c63-4881-81db-0aa0cb3a84c8 tempest-VolumesSnapshotsTestJSON-478555694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab.b8f45760-a425-47a9-b335-c37b4dc474a2 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:30 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab.b8f45760-a425-47a9-b335-c37b4dc474a2 Sep 04 15:55:30 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:30 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-c68d5023-6c61-4fac-885a-ff1cce0276cb tempest-GroupSnapshotsTest-720540587 None] GroupSnapshot 986dafc9-5a1f-405b-a60a-5ec7973067f9: creating. Sep 04 15:55:30 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c68d5023-6c61-4fac-885a-ff1cce0276cb tempest-GroupSnapshotsTest-720540587 None] Group snapshot 986dafc9-5a1f-405b-a60a-5ec7973067f9: creating. {{(pid=87490) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 04 15:55:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c68d5023-6c61-4fac-885a-ff1cce0276cb tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:30 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cda8db3c-f5bf-4b68-b71b-1bd757e56af0 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f8219b81-29e8-4d4e-9059-cf53a1c21f21" returned: 0 in 0.299s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:30 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cda8db3c-f5bf-4b68-b71b-1bd757e56af0 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-f8219b81-29e8-4d4e-9059-cf53a1c21f21" released by "delete_volume" :: held 0.776s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:30 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-cda8db3c-f5bf-4b68-b71b-1bd757e56af0 tempest-VolumesSnapshotTestJSON-1655945923 None] Created reservations ['f2c8e10e-075f-4c4d-b259-f0d46afcad05', 'd3cc3b02-d8c0-4674-b5f8-07c4cb6cbdf6', '2ed6f0c0-4133-469a-8801-a7936d0f0bd6', 'cdc1fd86-a632-44c5-ac65-0ec5a5d625fd'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:55:30 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-33411eba-c952-4c46-885e-d9eccb9a8dae req-f1230355-4c63-4881-81db-0aa0cb3a84c8 tempest-VolumesSnapshotsTestJSON-478555694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab.b8f45760-a425-47a9-b335-c37b4dc474a2" returned: 0 in 0.360s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:30 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [req-33411eba-c952-4c46-885e-d9eccb9a8dae req-f1230355-4c63-4881-81db-0aa0cb3a84c8 tempest-VolumesSnapshotsTestJSON-478555694 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab.b8f45760-a425-47a9-b335-c37b4dc474a2 is being set with open permissions: ugo+rw Sep 04 15:55:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-33411eba-c952-4c46-885e-d9eccb9a8dae req-f1230355-4c63-4881-81db-0aa0cb3a84c8 tempest-VolumesSnapshotsTestJSON-478555694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab.b8f45760-a425-47a9-b335-c37b4dc474a2 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:30 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab.b8f45760-a425-47a9-b335-c37b4dc474a2 Sep 04 15:55:30 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-cda8db3c-f5bf-4b68-b71b-1bd757e56af0 tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-cda8db3c-f5bf-4b68-b71b-1bd757e56af0 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-cda8db3c-f5bf-4b68-b71b-1bd757e56af0 tempest-VolumesSnapshotTestJSON-1655945923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-cda8db3c-f5bf-4b68-b71b-1bd757e56af0 tempest-VolumesSnapshotTestJSON-1655945923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-cda8db3c-f5bf-4b68-b71b-1bd757e56af0 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cda8db3c-f5bf-4b68-b71b-1bd757e56af0 tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-dc63de31-350f-4990-8d17-2d9729591bc5 tempest-GroupSnapshotsV319Test-184294332 None] Acquiring lock "cinder-quobyte-4619da82-234a-430f-b544-799d358ffe37" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-dc63de31-350f-4990-8d17-2d9729591bc5 tempest-GroupSnapshotsV319Test-184294332 None] Lock "cinder-quobyte-4619da82-234a-430f-b544-799d358ffe37" acquired by "delete_volume" :: waited 0.020s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:31 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:55:31 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f9716f-d253-4622-b42d-d1a253b98e65]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-dc63de31-350f-4990-8d17-2d9729591bc5 tempest-GroupSnapshotsV319Test-184294332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:31 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-33411eba-c952-4c46-885e-d9eccb9a8dae req-f1230355-4c63-4881-81db-0aa0cb3a84c8 tempest-VolumesSnapshotsTestJSON-478555694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab.b8f45760-a425-47a9-b335-c37b4dc474a2" returned: 0 in 0.309s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-33411eba-c952-4c46-885e-d9eccb9a8dae req-f1230355-4c63-4881-81db-0aa0cb3a84c8 tempest-VolumesSnapshotsTestJSON-478555694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:31 devstack sudo[96904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37 Sep 04 15:55:31 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-23d34839-e956-4b39-9abf-fc441e398d3f tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "cinder-5f04fa9a-acbd-4e21-9cd4-afd8627803cf-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:31 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab.info Sep 04 15:55:31 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-23d34839-e956-4b39-9abf-fc441e398d3f tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-5f04fa9a-acbd-4e21-9cd4-afd8627803cf-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:31 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cda8db3c-f5bf-4b68-b71b-1bd757e56af0 tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.325s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-cda8db3c-f5bf-4b68-b71b-1bd757e56af0 tempest-VolumesSnapshotTestJSON-1655945923 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:55:31 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-cda8db3c-f5bf-4b68-b71b-1bd757e56af0 tempest-VolumesSnapshotTestJSON-1655945923 None] Deleted volume successfully. Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-23d34839-e956-4b39-9abf-fc441e398d3f tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "cinder-quobyte-5f04fa9a-acbd-4e21-9cd4-afd8627803cf" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cda8db3c-f5bf-4b68-b71b-1bd757e56af0 tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-f8219b81-29e8-4d4e-9059-cf53a1c21f21-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-23d34839-e956-4b39-9abf-fc441e398d3f tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-5f04fa9a-acbd-4e21-9cd4-afd8627803cf" acquired by "delete_volume" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29446f6-43e5-41b4-bc0d-165d603c1ef1]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23d34839-e956-4b39-9abf-fc441e398d3f tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:31 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-33411eba-c952-4c46-885e-d9eccb9a8dae req-f1230355-4c63-4881-81db-0aa0cb3a84c8 tempest-VolumesSnapshotsTestJSON-478555694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab.info" returned: 0 in 0.300s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:31 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [req-33411eba-c952-4c46-885e-d9eccb9a8dae req-f1230355-4c63-4881-81db-0aa0cb3a84c8 tempest-VolumesSnapshotsTestJSON-478555694 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab.info is being set with open permissions: ugo+rw Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-33411eba-c952-4c46-885e-d9eccb9a8dae req-f1230355-4c63-4881-81db-0aa0cb3a84c8 tempest-VolumesSnapshotsTestJSON-478555694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:31 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:31 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf Sep 04 15:55:31 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-dc63de31-350f-4990-8d17-2d9729591bc5 tempest-GroupSnapshotsV319Test-184294332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37" returned: 0 in 0.435s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-dc63de31-350f-4990-8d17-2d9729591bc5 tempest-GroupSnapshotsV319Test-184294332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:31 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab.info Sep 04 15:55:31 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:31 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37 Sep 04 15:55:31 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:31 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-33411eba-c952-4c46-885e-d9eccb9a8dae req-f1230355-4c63-4881-81db-0aa0cb3a84c8 tempest-VolumesSnapshotsTestJSON-478555694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab.info" returned: 0 in 0.264s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-33411eba-c952-4c46-885e-d9eccb9a8dae req-f1230355-4c63-4881-81db-0aa0cb3a84c8 tempest-VolumesSnapshotsTestJSON-478555694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.352s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c68d5023-6c61-4fac-885a-ff1cce0276cb tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.129s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:31 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-c68d5023-6c61-4fac-885a-ff1cce0276cb tempest-GroupSnapshotsTest-720540587 None] Creating offline snapshot 7894fe80-8cf1-47cb-9e8d-71f4229d7a5d of volume da4415ad-d85c-496d-a0a1-a7b39f14a1a0 {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:55:31 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-33411eba-c952-4c46-885e-d9eccb9a8dae req-f1230355-4c63-4881-81db-0aa0cb3a84c8 tempest-VolumesSnapshotsTestJSON-478555694 None] Create snapshot completed successfully Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23d34839-e956-4b39-9abf-fc441e398d3f tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf" returned: 0 in 0.440s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23d34839-e956-4b39-9abf-fc441e398d3f tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[929e64ba-53d8-4f18-a2d6-d6b6bb42c256]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:31 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c68d5023-6c61-4fac-885a-ff1cce0276cb tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:31 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf Sep 04 15:55:31 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-dc63de31-350f-4990-8d17-2d9729591bc5 tempest-GroupSnapshotsV319Test-184294332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4619da82-234a-430f-b544-799d358ffe37" returned: 0 in 0.347s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-dc63de31-350f-4990-8d17-2d9729591bc5 tempest-GroupSnapshotsV319Test-184294332 None] Lock "cinder-quobyte-4619da82-234a-430f-b544-799d358ffe37" released by "delete_volume" :: held 0.886s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-dc63de31-350f-4990-8d17-2d9729591bc5 tempest-GroupSnapshotsV319Test-184294332 None] Created reservations ['632801f4-9cba-4fed-9d0c-84db6c8d74a1'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:55:32 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0 Sep 04 15:55:32 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:32 devstack cinder-volume[87490]: WARNING cinder.quota [None req-dc63de31-350f-4990-8d17-2d9729591bc5 tempest-GroupSnapshotsV319Test-184294332 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-357541065 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-357541065, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-dc63de31-350f-4990-8d17-2d9729591bc5 tempest-GroupSnapshotsV319Test-184294332 None] Created reservations ['fd9fef9c-e404-4849-9081-59d28a3bdbdc', '5fd6f293-6b46-47a3-8510-f3a5e5ae5014', '8fd1f2fd-b83a-4fba-aba2-68b22530c45f', 'f9f2f2de-d012-4226-8977-b6470946b910'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-dc63de31-350f-4990-8d17-2d9729591bc5 tempest-GroupSnapshotsV319Test-184294332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-dc63de31-350f-4990-8d17-2d9729591bc5 tempest-GroupSnapshotsV319Test-184294332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-dc63de31-350f-4990-8d17-2d9729591bc5 tempest-GroupSnapshotsV319Test-184294332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-dc63de31-350f-4990-8d17-2d9729591bc5 tempest-GroupSnapshotsV319Test-184294332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-dc63de31-350f-4990-8d17-2d9729591bc5 tempest-GroupSnapshotsV319Test-184294332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-dc63de31-350f-4990-8d17-2d9729591bc5 tempest-GroupSnapshotsV319Test-184294332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:32 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23d34839-e956-4b39-9abf-fc441e398d3f tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5f04fa9a-acbd-4e21-9cd4-afd8627803cf" returned: 0 in 0.294s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:32 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:55:32 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-23d34839-e956-4b39-9abf-fc441e398d3f tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-quobyte-5f04fa9a-acbd-4e21-9cd4-afd8627803cf" released by "delete_volume" :: held 0.817s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-fca31417-d3bd-4c38-b550-220fa7d3b496 req-b90ada7b-bbe3-47ec-a184-fe99e6c04a6b tempest-VolumesSnapshotsTestJSON-478555694 None] Acquiring lock "cinder-b8f45760-a425-47a9-b335-c37b4dc474a2-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-fca31417-d3bd-4c38-b550-220fa7d3b496 req-b90ada7b-bbe3-47ec-a184-fe99e6c04a6b tempest-VolumesSnapshotsTestJSON-478555694 None] Lock "cinder-b8f45760-a425-47a9-b335-c37b4dc474a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-fca31417-d3bd-4c38-b550-220fa7d3b496 req-b90ada7b-bbe3-47ec-a184-fe99e6c04a6b tempest-VolumesSnapshotsTestJSON-478555694 None] Acquiring lock "cinder-quobyte-a4b7a736-b9dd-40cc-a2ac-33fc437802ab" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-fca31417-d3bd-4c38-b550-220fa7d3b496 req-b90ada7b-bbe3-47ec-a184-fe99e6c04a6b tempest-VolumesSnapshotsTestJSON-478555694 None] Lock "cinder-quobyte-a4b7a736-b9dd-40cc-a2ac-33fc437802ab" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-fca31417-d3bd-4c38-b550-220fa7d3b496 req-b90ada7b-bbe3-47ec-a184-fe99e6c04a6b tempest-VolumesSnapshotsTestJSON-478555694 None] Acquiring lock "cinder-quobyte-b8f45760-a425-47a9-b335-c37b4dc474a2" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-fca31417-d3bd-4c38-b550-220fa7d3b496 req-b90ada7b-bbe3-47ec-a184-fe99e6c04a6b tempest-VolumesSnapshotsTestJSON-478555694 None] Lock "cinder-quobyte-b8f45760-a425-47a9-b335-c37b4dc474a2" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [req-fca31417-d3bd-4c38-b550-220fa7d3b496 req-b90ada7b-bbe3-47ec-a184-fe99e6c04a6b tempest-VolumesSnapshotsTestJSON-478555694 None] Deleting offline snapshot b8f45760-a425-47a9-b335-c37b4dc474a2 of volume a4b7a736-b9dd-40cc-a2ac-33fc437802ab {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [req-fca31417-d3bd-4c38-b550-220fa7d3b496 req-b90ada7b-bbe3-47ec-a184-fe99e6c04a6b tempest-VolumesSnapshotsTestJSON-478555694 None] snapshot_file for this snap is: volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab.b8f45760-a425-47a9-b335-c37b4dc474a2 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-23d34839-e956-4b39-9abf-fc441e398d3f tempest-VolumesSnapshotTestJSON-1655945923 None] Created reservations ['1d3a007e-ef42-43b1-b531-143b718ddf8d', '816bffa0-0eda-4854-aec4-8f4d0f072b6e', 'ceab9677-ec3c-44b2-9bd4-2e113d65537a', 'cb82a93e-8783-42ae-832b-ea703194c38e'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4b6535-6043-4460-ad2a-6f3712ede5f7]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-fca31417-d3bd-4c38-b550-220fa7d3b496 req-b90ada7b-bbe3-47ec-a184-fe99e6c04a6b tempest-VolumesSnapshotsTestJSON-478555694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab.b8f45760-a425-47a9-b335-c37b4dc474a2 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:32 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c68d5023-6c61-4fac-885a-ff1cce0276cb tempest-GroupSnapshotsTest-720540587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0" returned: 0 in 0.518s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c68d5023-6c61-4fac-885a-ff1cce0276cb tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.7894fe80-8cf1-47cb-9e8d-71f4229d7a5d 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:32 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.7894fe80-8cf1-47cb-9e8d-71f4229d7a5d 1G Sep 04 15:55:32 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:32 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-dc63de31-350f-4990-8d17-2d9729591bc5 tempest-GroupSnapshotsV319Test-184294332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.360s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-23d34839-e956-4b39-9abf-fc441e398d3f tempest-VolumesSnapshotTestJSON-1655945923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-23d34839-e956-4b39-9abf-fc441e398d3f tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-23d34839-e956-4b39-9abf-fc441e398d3f tempest-VolumesSnapshotTestJSON-1655945923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-23d34839-e956-4b39-9abf-fc441e398d3f tempest-VolumesSnapshotTestJSON-1655945923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-23d34839-e956-4b39-9abf-fc441e398d3f tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23d34839-e956-4b39-9abf-fc441e398d3f tempest-VolumesSnapshotTestJSON-1655945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:32 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab.b8f45760-a425-47a9-b335-c37b4dc474a2 Sep 04 15:55:32 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-dc63de31-350f-4990-8d17-2d9729591bc5 tempest-GroupSnapshotsV319Test-184294332 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:55:32 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-dc63de31-350f-4990-8d17-2d9729591bc5 tempest-GroupSnapshotsV319Test-184294332 None] Delete group completed successfully. Sep 04 15:55:32 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:55:32 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:32 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-fca31417-d3bd-4c38-b550-220fa7d3b496 req-b90ada7b-bbe3-47ec-a184-fe99e6c04a6b tempest-VolumesSnapshotsTestJSON-478555694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab.b8f45760-a425-47a9-b335-c37b4dc474a2" returned: 0 in 0.453s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [req-fca31417-d3bd-4c38-b550-220fa7d3b496 req-b90ada7b-bbe3-47ec-a184-fe99e6c04a6b tempest-VolumesSnapshotsTestJSON-478555694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:55:32 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23d34839-e956-4b39-9abf-fc441e398d3f tempest-VolumesSnapshotTestJSON-1655945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.332s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-23d34839-e956-4b39-9abf-fc441e398d3f tempest-VolumesSnapshotTestJSON-1655945923 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:55:32 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-23d34839-e956-4b39-9abf-fc441e398d3f tempest-VolumesSnapshotTestJSON-1655945923 None] Deleted volume successfully. Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b5a731-6a97-4c00-8d05-7e9a5ed85a96]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-fca31417-d3bd-4c38-b550-220fa7d3b496 req-b90ada7b-bbe3-47ec-a184-fe99e6c04a6b tempest-VolumesSnapshotsTestJSON-478555694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:32 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-23d34839-e956-4b39-9abf-fc441e398d3f tempest-VolumesSnapshotTestJSON-1655945923 None] Lock "cinder-5f04fa9a-acbd-4e21-9cd4-afd8627803cf-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c68d5023-6c61-4fac-885a-ff1cce0276cb tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.7894fe80-8cf1-47cb-9e8d-71f4229d7a5d 1G" returned: 0 in 0.494s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c68d5023-6c61-4fac-885a-ff1cce0276cb tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.7894fe80-8cf1-47cb-9e8d-71f4229d7a5d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:32 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.7894fe80-8cf1-47cb-9e8d-71f4229d7a5d Sep 04 15:55:32 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:33 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab Sep 04 15:55:33 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:33 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c68d5023-6c61-4fac-885a-ff1cce0276cb tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.7894fe80-8cf1-47cb-9e8d-71f4229d7a5d" returned: 0 in 0.310s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:33 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-c68d5023-6c61-4fac-885a-ff1cce0276cb tempest-GroupSnapshotsTest-720540587 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.7894fe80-8cf1-47cb-9e8d-71f4229d7a5d is being set with open permissions: ugo+rw: NotImplementedError Sep 04 15:55:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c68d5023-6c61-4fac-885a-ff1cce0276cb tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.7894fe80-8cf1-47cb-9e8d-71f4229d7a5d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:33 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.7894fe80-8cf1-47cb-9e8d-71f4229d7a5d Sep 04 15:55:33 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:33 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-fca31417-d3bd-4c38-b550-220fa7d3b496 req-b90ada7b-bbe3-47ec-a184-fe99e6c04a6b tempest-VolumesSnapshotsTestJSON-478555694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab" returned: 0 in 0.382s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-fca31417-d3bd-4c38-b550-220fa7d3b496 req-b90ada7b-bbe3-47ec-a184-fe99e6c04a6b tempest-VolumesSnapshotsTestJSON-478555694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab.b8f45760-a425-47a9-b335-c37b4dc474a2 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:33 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab.b8f45760-a425-47a9-b335-c37b4dc474a2 Sep 04 15:55:33 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:33 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c68d5023-6c61-4fac-885a-ff1cce0276cb tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.7894fe80-8cf1-47cb-9e8d-71f4229d7a5d" returned: 0 in 0.279s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c68d5023-6c61-4fac-885a-ff1cce0276cb tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:33 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.info Sep 04 15:55:33 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:33 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-fca31417-d3bd-4c38-b550-220fa7d3b496 req-b90ada7b-bbe3-47ec-a184-fe99e6c04a6b tempest-VolumesSnapshotsTestJSON-478555694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab.b8f45760-a425-47a9-b335-c37b4dc474a2" returned: 0 in 0.402s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-fca31417-d3bd-4c38-b550-220fa7d3b496 req-b90ada7b-bbe3-47ec-a184-fe99e6c04a6b tempest-VolumesSnapshotsTestJSON-478555694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab.b8f45760-a425-47a9-b335-c37b4dc474a2 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:33 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab.b8f45760-a425-47a9-b335-c37b4dc474a2 Sep 04 15:55:33 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:33 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c68d5023-6c61-4fac-885a-ff1cce0276cb tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.info" returned: 0 in 0.401s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:34 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-c68d5023-6c61-4fac-885a-ff1cce0276cb tempest-GroupSnapshotsTest-720540587 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 15:55:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c68d5023-6c61-4fac-885a-ff1cce0276cb tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:34 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.info Sep 04 15:55:34 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:34 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-fca31417-d3bd-4c38-b550-220fa7d3b496 req-b90ada7b-bbe3-47ec-a184-fe99e6c04a6b tempest-VolumesSnapshotsTestJSON-478555694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab.b8f45760-a425-47a9-b335-c37b4dc474a2" returned: 0 in 0.331s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:34 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-fca31417-d3bd-4c38-b550-220fa7d3b496 req-b90ada7b-bbe3-47ec-a184-fe99e6c04a6b tempest-VolumesSnapshotsTestJSON-478555694 None] Lock "cinder-quobyte-b8f45760-a425-47a9-b335-c37b4dc474a2" released by "_delete_snapshot" :: held 1.713s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:34 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-fca31417-d3bd-4c38-b550-220fa7d3b496 req-b90ada7b-bbe3-47ec-a184-fe99e6c04a6b tempest-VolumesSnapshotsTestJSON-478555694 None] Lock "cinder-quobyte-a4b7a736-b9dd-40cc-a2ac-33fc437802ab" released by "delete_snapshot" :: held 1.762s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:34 devstack cinder-volume[87490]: DEBUG cinder.quota [req-fca31417-d3bd-4c38-b550-220fa7d3b496 req-b90ada7b-bbe3-47ec-a184-fe99e6c04a6b tempest-VolumesSnapshotsTestJSON-478555694 None] Created reservations ['94a1f7f7-135c-4033-aae6-f040056d0a9b', 'a54b48f2-5f28-4eb8-81b1-4c3c0dd92ef4', '73f16881-e7a5-4085-98d9-acec86f4699f', 'b51968ae-34a0-4251-acba-d3c759f993f0'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:55:34 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-fca31417-d3bd-4c38-b550-220fa7d3b496 req-b90ada7b-bbe3-47ec-a184-fe99e6c04a6b tempest-VolumesSnapshotsTestJSON-478555694 None] Delete snapshot completed successfully. Sep 04 15:55:34 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-fca31417-d3bd-4c38-b550-220fa7d3b496 req-b90ada7b-bbe3-47ec-a184-fe99e6c04a6b tempest-VolumesSnapshotsTestJSON-478555694 None] Lock "cinder-b8f45760-a425-47a9-b335-c37b4dc474a2-delete_snapshot" released by "delete_snapshot" :: held 1.956s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:34 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c68d5023-6c61-4fac-885a-ff1cce0276cb tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.info" returned: 0 in 0.310s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c68d5023-6c61-4fac-885a-ff1cce0276cb tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.430s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:34 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-c68d5023-6c61-4fac-885a-ff1cce0276cb tempest-GroupSnapshotsTest-720540587 None] group_snapshot 986dafc9-5a1f-405b-a60a-5ec7973067f9: created successfully Sep 04 15:55:34 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-0c3e09da-2095-48a8-b566-f13977db51cc req-904e52cf-de19-4ae1-a1b1-2926b8633296 tempest-VolumesSnapshotsTestJSON-478555694 None] Acquiring lock "cinder-a4b7a736-b9dd-40cc-a2ac-33fc437802ab-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:34 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-0c3e09da-2095-48a8-b566-f13977db51cc req-904e52cf-de19-4ae1-a1b1-2926b8633296 tempest-VolumesSnapshotsTestJSON-478555694 None] Lock "cinder-a4b7a736-b9dd-40cc-a2ac-33fc437802ab-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:34 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-0c3e09da-2095-48a8-b566-f13977db51cc req-904e52cf-de19-4ae1-a1b1-2926b8633296 tempest-VolumesSnapshotsTestJSON-478555694 None] Acquiring lock "cinder-quobyte-a4b7a736-b9dd-40cc-a2ac-33fc437802ab" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:34 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-0c3e09da-2095-48a8-b566-f13977db51cc req-904e52cf-de19-4ae1-a1b1-2926b8633296 tempest-VolumesSnapshotsTestJSON-478555694 None] Lock "cinder-quobyte-a4b7a736-b9dd-40cc-a2ac-33fc437802ab" acquired by "delete_volume" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:34 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc913761-111d-407d-a0a5-5ded075413d9]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-0c3e09da-2095-48a8-b566-f13977db51cc req-904e52cf-de19-4ae1-a1b1-2926b8633296 tempest-VolumesSnapshotsTestJSON-478555694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:34 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab Sep 04 15:55:34 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:35 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-0c3e09da-2095-48a8-b566-f13977db51cc req-904e52cf-de19-4ae1-a1b1-2926b8633296 tempest-VolumesSnapshotsTestJSON-478555694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab" returned: 0 in 0.436s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-0c3e09da-2095-48a8-b566-f13977db51cc req-904e52cf-de19-4ae1-a1b1-2926b8633296 tempest-VolumesSnapshotsTestJSON-478555694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:35 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab Sep 04 15:55:35 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:35 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-0c3e09da-2095-48a8-b566-f13977db51cc req-904e52cf-de19-4ae1-a1b1-2926b8633296 tempest-VolumesSnapshotsTestJSON-478555694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a4b7a736-b9dd-40cc-a2ac-33fc437802ab" returned: 0 in 0.371s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-0c3e09da-2095-48a8-b566-f13977db51cc req-904e52cf-de19-4ae1-a1b1-2926b8633296 tempest-VolumesSnapshotsTestJSON-478555694 None] Lock "cinder-quobyte-a4b7a736-b9dd-40cc-a2ac-33fc437802ab" released by "delete_volume" :: held 0.880s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:35 devstack cinder-volume[87490]: DEBUG cinder.quota [req-0c3e09da-2095-48a8-b566-f13977db51cc req-904e52cf-de19-4ae1-a1b1-2926b8633296 tempest-VolumesSnapshotsTestJSON-478555694 None] Created reservations ['7235866a-6584-4aa5-9ef1-6155debc94ae', '7677030a-76b3-474c-98b0-a35feca199d4', '27034560-8b38-4f0a-9867-c6126a781470', '7696e07d-0fb8-4253-8c19-2454d6d5f0d1'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:55:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-0c3e09da-2095-48a8-b566-f13977db51cc req-904e52cf-de19-4ae1-a1b1-2926b8633296 tempest-VolumesSnapshotsTestJSON-478555694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-0c3e09da-2095-48a8-b566-f13977db51cc req-904e52cf-de19-4ae1-a1b1-2926b8633296 tempest-VolumesSnapshotsTestJSON-478555694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [req-0c3e09da-2095-48a8-b566-f13977db51cc req-904e52cf-de19-4ae1-a1b1-2926b8633296 tempest-VolumesSnapshotsTestJSON-478555694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:55:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [req-0c3e09da-2095-48a8-b566-f13977db51cc req-904e52cf-de19-4ae1-a1b1-2926b8633296 tempest-VolumesSnapshotsTestJSON-478555694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:55:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-0c3e09da-2095-48a8-b566-f13977db51cc req-904e52cf-de19-4ae1-a1b1-2926b8633296 tempest-VolumesSnapshotsTestJSON-478555694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-0c3e09da-2095-48a8-b566-f13977db51cc req-904e52cf-de19-4ae1-a1b1-2926b8633296 tempest-VolumesSnapshotsTestJSON-478555694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:35 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:55:35 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "cinder-quobyte-7894fe80-8cf1-47cb-9e8d-71f4229d7a5d-41222c10-e3eb-4a8c-8b97-f9a8d322f12b" by "_create_volume_from_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-7894fe80-8cf1-47cb-9e8d-71f4229d7a5d-41222c10-e3eb-4a8c-8b97-f9a8d322f12b" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Creating volume 41222c10-e3eb-4a8c-8b97-f9a8d322f12b from snapshot 7894fe80-8cf1-47cb-9e8d-71f4229d7a5d {{(pid=87490) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "cinder-quobyte-41222c10-e3eb-4a8c-8b97-f9a8d322f12b" by "_copy_volume_from_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-41222c10-e3eb-4a8c-8b97-f9a8d322f12b" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] snapshot: 7894fe80-8cf1-47cb-9e8d-71f4229d7a5d, volume: 41222c10-e3eb-4a8c-8b97-f9a8d322f12b, {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[15686909-3e82-4a10-bf12-38adc3c317f5]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.7894fe80-8cf1-47cb-9e8d-71f4229d7a5d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:36 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-0c3e09da-2095-48a8-b566-f13977db51cc req-904e52cf-de19-4ae1-a1b1-2926b8633296 tempest-VolumesSnapshotsTestJSON-478555694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.415s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG cinder.manager [req-0c3e09da-2095-48a8-b566-f13977db51cc req-904e52cf-de19-4ae1-a1b1-2926b8633296 tempest-VolumesSnapshotsTestJSON-478555694 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:55:36 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-0c3e09da-2095-48a8-b566-f13977db51cc req-904e52cf-de19-4ae1-a1b1-2926b8633296 tempest-VolumesSnapshotsTestJSON-478555694 None] Deleted volume successfully. Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-0c3e09da-2095-48a8-b566-f13977db51cc req-904e52cf-de19-4ae1-a1b1-2926b8633296 tempest-VolumesSnapshotsTestJSON-478555694 None] Lock "cinder-a4b7a736-b9dd-40cc-a2ac-33fc437802ab-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:36 devstack sudo[96989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.7894fe80-8cf1-47cb-9e8d-71f4229d7a5d Sep 04 15:55:36 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:36 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.7894fe80-8cf1-47cb-9e8d-71f4229d7a5d" returned: 0 in 0.568s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a5957d-1d4c-41a0-8c83-3e06b21ef765]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:36 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0 Sep 04 15:55:36 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:37 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0" returned: 0 in 0.487s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:37 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0 {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 15:55:37 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Creating direct copy from snapshot {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 15:55:37 devstack cinder-volume[87490]: DEBUG cinder.utils [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Path /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-41222c10-e3eb-4a8c-8b97-f9a8d322f12b not found in is_blk_device check {{(pid=87490) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 15:55:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-41222c10-e3eb-4a8c-8b97-f9a8d322f12b {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:37 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-41222c10-e3eb-4a8c-8b97-f9a8d322f12b Sep 04 15:55:37 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:55:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:55:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:55:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:38 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:55:38 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:38 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.550s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:38 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:55:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager._thread_info {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:55:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread count: 28 {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:55:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread info: [<_MainThread(MainThread, started 138899118923904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:55:40 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-874fc671-3065-4f9b-a4f0-ea8e3ab61126 tempest-GroupsV314Test-585939586 None] Group tempest-GroupsV314Test-Group-1877017125: creating Sep 04 15:55:40 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-874fc671-3065-4f9b-a4f0-ea8e3ab61126 tempest-GroupsV314Test-585939586 None] Group tempest-GroupsV314Test-Group-1877017125: created successfully Sep 04 15:55:40 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-874fc671-3065-4f9b-a4f0-ea8e3ab61126 tempest-GroupsV314Test-585939586 None] Create group completed successfully. Sep 04 15:55:43 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-41222c10-e3eb-4a8c-8b97-f9a8d322f12b" returned: 0 in 5.994s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-41222c10-e3eb-4a8c-8b97-f9a8d322f12b {{(pid=87490) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 15:55:43 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Converted 1024.00 MB image at 170.81 MB/s Sep 04 15:55:43 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-41222c10-e3eb-4a8c-8b97-f9a8d322f12b is being set with open permissions: ugo+rw: NotImplementedError Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-41222c10-e3eb-4a8c-8b97-f9a8d322f12b {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:43 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-41222c10-e3eb-4a8c-8b97-f9a8d322f12b Sep 04 15:55:43 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Flow 'volume_create_manager' (2bd46728-25c9-4e07-845b-f70797dbf951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeea91f6-e435-48b3-b2a3-1ef030fef3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeea91f6-e435-48b3-b2a3-1ef030fef3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1134411265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db7d5475-8ec1-45ef-bdbf-cb9cc8c49892,host='devstack@QuobyteHD#QuobyteHD',id=479e8c4f-f195-41fc-8c93-25b8ddc039d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6849a85c314744e08f89537b80fd0a91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:43Z,use_quota=True,user_id='172c911f93e74b4183d1a1feff064827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83d29058-4c1e-4d1d-b6ea-8ec64a18e14b),volume_type_id=83d29058-4c1e-4d1d-b6ea-8ec64a18e14b)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f07e2c-9ca2-4d70-a3a6-22d90583706a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f07e2c-9ca2-4d70-a3a6-22d90583706a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b7abd1-cf05-42e8-b793-9d06bdaaecb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b7abd1-cf05-42e8-b793-9d06bdaaecb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '479e8c4f-f195-41fc-8c93-25b8ddc039d7', 'volume_name': 'volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7524c5b6-fe60-410a-9123-fa3f277af5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7524c5b6-fe60-410a-9123-fa3f277af5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500d987f-b76e-4809-872b-0d791a13957b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:43 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Volume 479e8c4f-f195-41fc-8c93-25b8ddc039d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7', 'volume_size': 1} Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:43 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-41222c10-e3eb-4a8c-8b97-f9a8d322f12b" returned: 0 in 0.377s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-41222c10-e3eb-4a8c-8b97-f9a8d322f12b" released by "_copy_volume_from_snapshot" :: held 7.555s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-7894fe80-8cf1-47cb-9e8d-71f4229d7a5d-41222c10-e3eb-4a8c-8b97-f9a8d322f12b" released by "_create_volume_from_snapshot" :: held 7.649s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.675s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.108s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=db7d5475-8ec1-45ef-bdbf-cb9cc8c49892,created_at=2026-09-04T13:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1134411265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db7d5475-8ec1-45ef-bdbf-cb9cc8c49892,host='devstack@QuobyteHD#QuobyteHD',id=479e8c4f-f195-41fc-8c93-25b8ddc039d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6849a85c314744e08f89537b80fd0a91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:43Z,use_quota=True,user_id='172c911f93e74b4183d1a1feff064827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83d29058-4c1e-4d1d-b6ea-8ec64a18e14b),volume_type_id=83d29058-4c1e-4d1d-b6ea-8ec64a18e14b)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Creating volume 479e8c4f-f195-41fc-8c93-25b8ddc039d7 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:55:43 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:55:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:43 devstack sudo[97022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7 1073741824 Sep 04 15:55:43 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:43 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-a8fbbefe-bf69-44dd-ac8a-3350c2432762 tempest-GroupSnapshotsTest-720540587 None] Create group from source-snapshot-986dafc9-5a1f-405b-a60a-5ec7973067f9 completed successfully. Sep 04 15:55:44 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7 1073741824" returned: 0 in 0.496s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:44 devstack sudo[97028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7 Sep 04 15:55:44 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:44 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7" returned: 0 in 0.319s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:55:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500d987f-b76e-4809-872b-0d791a13957b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69cfb8f9-12d9-4e1f-8d75-c5ebae2a279c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:44 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Volume volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7 (479e8c4f-f195-41fc-8c93-25b8ddc039d7): created successfully Sep 04 15:55:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69cfb8f9-12d9-4e1f-8d75-c5ebae2a279c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Flow 'volume_create_manager' (2bd46728-25c9-4e07-845b-f70797dbf951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:44 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-e956bd75-aa8f-4b16-bb9e-42e41be1b4e9 tempest-GroupsV314Test-585939586 None] Created volume successfully. Sep 04 15:55:44 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2ab6b9eb-067b-4abb-88bc-77b298417baa tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "cinder-quobyte-41222c10-e3eb-4a8c-8b97-f9a8d322f12b" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:44 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2ab6b9eb-067b-4abb-88bc-77b298417baa tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-41222c10-e3eb-4a8c-8b97-f9a8d322f12b" acquired by "delete_volume" :: waited 0.020s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:45 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[49732c34-ab12-4d83-bce3-78cb19b15cd1]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2ab6b9eb-067b-4abb-88bc-77b298417baa tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-41222c10-e3eb-4a8c-8b97-f9a8d322f12b {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:45 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-41222c10-e3eb-4a8c-8b97-f9a8d322f12b Sep 04 15:55:45 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:45 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2ab6b9eb-067b-4abb-88bc-77b298417baa tempest-GroupSnapshotsTest-720540587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-41222c10-e3eb-4a8c-8b97-f9a8d322f12b" returned: 0 in 0.488s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2ab6b9eb-067b-4abb-88bc-77b298417baa tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-41222c10-e3eb-4a8c-8b97-f9a8d322f12b {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:45 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-41222c10-e3eb-4a8c-8b97-f9a8d322f12b Sep 04 15:55:45 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.003s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:45 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Cloning volume 479e8c4f-f195-41fc-8c93-25b8ddc039d7 to volume 5ae091a8-7ab9-4301-8ca3-d09cec6508cb Sep 04 15:55:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Creating offline snapshot b4ac2c75-2cc4-495b-8850-6561a0eb4e0c of volume 479e8c4f-f195-41fc-8c93-25b8ddc039d7 {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:55:45 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b4e393-18ac-4c91-8acb-dca41a2116d5]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:45 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7 Sep 04 15:55:45 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:46 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2ab6b9eb-067b-4abb-88bc-77b298417baa tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-41222c10-e3eb-4a8c-8b97-f9a8d322f12b" returned: 0 in 0.509s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:46 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2ab6b9eb-067b-4abb-88bc-77b298417baa tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-41222c10-e3eb-4a8c-8b97-f9a8d322f12b" released by "delete_volume" :: held 1.059s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:46 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-2ab6b9eb-067b-4abb-88bc-77b298417baa tempest-GroupSnapshotsTest-720540587 None] Created reservations ['989929a0-9a4f-41bf-9bf3-bec6dc9541b4'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:55:46 devstack cinder-volume[87490]: WARNING cinder.quota [None req-2ab6b9eb-067b-4abb-88bc-77b298417baa tempest-GroupSnapshotsTest-720540587 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1900743928 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1900743928, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:55:46 devstack cinder-volume[87490]: WARNING cinder.quota [None req-2ab6b9eb-067b-4abb-88bc-77b298417baa tempest-GroupSnapshotsTest-720540587 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1900743928 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1900743928, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:55:46 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-2ab6b9eb-067b-4abb-88bc-77b298417baa tempest-GroupSnapshotsTest-720540587 None] Created reservations ['cfb29fc5-4a81-4b1a-b95c-a590263afa38', '5426ad14-fd4a-4787-af53-a8ae94582c00', '97907072-28af-4316-9ff4-eb61706dc4d6', 'f96955ba-08e8-43cf-bb1f-5904854ab7b2'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:55:46 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7" returned: 0 in 0.531s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.b4ac2c75-2cc4-495b-8850-6561a0eb4e0c 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:46 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.b4ac2c75-2cc4-495b-8850-6561a0eb4e0c 1G Sep 04 15:55:46 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2ab6b9eb-067b-4abb-88bc-77b298417baa tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2ab6b9eb-067b-4abb-88bc-77b298417baa tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:46 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2ab6b9eb-067b-4abb-88bc-77b298417baa tempest-GroupSnapshotsTest-720540587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:55:46 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2ab6b9eb-067b-4abb-88bc-77b298417baa tempest-GroupSnapshotsTest-720540587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:55:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2ab6b9eb-067b-4abb-88bc-77b298417baa tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2ab6b9eb-067b-4abb-88bc-77b298417baa tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:46 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:55:46 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:46 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2ab6b9eb-067b-4abb-88bc-77b298417baa tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.315s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:46 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-2ab6b9eb-067b-4abb-88bc-77b298417baa tempest-GroupSnapshotsTest-720540587 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:55:46 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-2ab6b9eb-067b-4abb-88bc-77b298417baa tempest-GroupSnapshotsTest-720540587 None] Delete group completed successfully. Sep 04 15:55:46 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.b4ac2c75-2cc4-495b-8850-6561a0eb4e0c 1G" returned: 0 in 0.522s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.b4ac2c75-2cc4-495b-8850-6561a0eb4e0c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:46 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.b4ac2c75-2cc4-495b-8850-6561a0eb4e0c Sep 04 15:55:46 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:47 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.b4ac2c75-2cc4-495b-8850-6561a0eb4e0c" returned: 0 in 0.333s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:47 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.b4ac2c75-2cc4-495b-8850-6561a0eb4e0c is being set with open permissions: ugo+rw: NotImplementedError Sep 04 15:55:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.b4ac2c75-2cc4-495b-8850-6561a0eb4e0c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:47 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.b4ac2c75-2cc4-495b-8850-6561a0eb4e0c Sep 04 15:55:47 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:47 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.b4ac2c75-2cc4-495b-8850-6561a0eb4e0c" returned: 0 in 0.311s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:47 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.info Sep 04 15:55:47 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:47 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-9ebf6c73-d6a4-48bc-a35e-5569b5f6b771 tempest-GroupSnapshotsTest-720540587 None] group_snapshot 986dafc9-5a1f-405b-a60a-5ec7973067f9: deleting Sep 04 15:55:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9ebf6c73-d6a4-48bc-a35e-5569b5f6b771 tempest-GroupSnapshotsTest-720540587 None] group_snapshot 986dafc9-5a1f-405b-a60a-5ec7973067f9: deleting {{(pid=87490) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 04 15:55:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-9ebf6c73-d6a4-48bc-a35e-5569b5f6b771 tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "cinder-quobyte-da4415ad-d85c-496d-a0a1-a7b39f14a1a0" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-9ebf6c73-d6a4-48bc-a35e-5569b5f6b771 tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-da4415ad-d85c-496d-a0a1-a7b39f14a1a0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-9ebf6c73-d6a4-48bc-a35e-5569b5f6b771 tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "cinder-quobyte-7894fe80-8cf1-47cb-9e8d-71f4229d7a5d" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-9ebf6c73-d6a4-48bc-a35e-5569b5f6b771 tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-7894fe80-8cf1-47cb-9e8d-71f4229d7a5d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:47 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-9ebf6c73-d6a4-48bc-a35e-5569b5f6b771 tempest-GroupSnapshotsTest-720540587 None] Deleting offline snapshot 7894fe80-8cf1-47cb-9e8d-71f4229d7a5d of volume da4415ad-d85c-496d-a0a1-a7b39f14a1a0 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:55:47 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-9ebf6c73-d6a4-48bc-a35e-5569b5f6b771 tempest-GroupSnapshotsTest-720540587 None] snapshot_file for this snap is: volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.7894fe80-8cf1-47cb-9e8d-71f4229d7a5d {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:55:47 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d04a09-4079-4804-a761-d75d7b7347e2]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9ebf6c73-d6a4-48bc-a35e-5569b5f6b771 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.7894fe80-8cf1-47cb-9e8d-71f4229d7a5d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:47 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.7894fe80-8cf1-47cb-9e8d-71f4229d7a5d Sep 04 15:55:47 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:48 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.info" returned: 0 in 0.428s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:48 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 15:55:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:48 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.info Sep 04 15:55:48 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:48 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9ebf6c73-d6a4-48bc-a35e-5569b5f6b771 tempest-GroupSnapshotsTest-720540587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.7894fe80-8cf1-47cb-9e8d-71f4229d7a5d" returned: 0 in 0.476s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-9ebf6c73-d6a4-48bc-a35e-5569b5f6b771 tempest-GroupSnapshotsTest-720540587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:55:48 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[56887230-a68f-44b6-b7b1-af517a1550d6]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9ebf6c73-d6a4-48bc-a35e-5569b5f6b771 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:48 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.info" returned: 0 in 0.329s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:48 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Acquiring lock "cinder-quobyte-5ae091a8-7ab9-4301-8ca3-d09cec6508cb" by "_copy_volume_from_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:48 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Lock "cinder-quobyte-5ae091a8-7ab9-4301-8ca3-d09cec6508cb" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] snapshot: b4ac2c75-2cc4-495b-8850-6561a0eb4e0c, volume: 5ae091a8-7ab9-4301-8ca3-d09cec6508cb, {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 15:55:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:55:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:55:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:48 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0 Sep 04 15:55:48 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:48 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5193dd-c060-4ec2-97e8-0aaa7d922842]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.b4ac2c75-2cc4-495b-8850-6561a0eb4e0c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:48 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.b4ac2c75-2cc4-495b-8850-6561a0eb4e0c Sep 04 15:55:48 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:48 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.b4ac2c75-2cc4-495b-8850-6561a0eb4e0c" returned: 0 in 0.488s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:55:49 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9ebf6c73-d6a4-48bc-a35e-5569b5f6b771 tempest-GroupSnapshotsTest-720540587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0" returned: 0 in 0.678s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9ebf6c73-d6a4-48bc-a35e-5569b5f6b771 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.7894fe80-8cf1-47cb-9e8d-71f4229d7a5d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:49 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0df299f-3d05-47a8-bb1d-e5712b76687d]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:49 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.7894fe80-8cf1-47cb-9e8d-71f4229d7a5d Sep 04 15:55:49 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:49 devstack sudo[97092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7 Sep 04 15:55:49 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:49 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9ebf6c73-d6a4-48bc-a35e-5569b5f6b771 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.7894fe80-8cf1-47cb-9e8d-71f4229d7a5d" returned: 0 in 0.398s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9ebf6c73-d6a4-48bc-a35e-5569b5f6b771 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.7894fe80-8cf1-47cb-9e8d-71f4229d7a5d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:49 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.7894fe80-8cf1-47cb-9e8d-71f4229d7a5d Sep 04 15:55:49 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:49 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7" returned: 0 in 0.554s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7 {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 15:55:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Creating direct copy from snapshot {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 15:55:49 devstack cinder-volume[87490]: DEBUG cinder.utils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Path /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5ae091a8-7ab9-4301-8ca3-d09cec6508cb not found in is_blk_device check {{(pid=87490) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 15:55:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5ae091a8-7ab9-4301-8ca3-d09cec6508cb {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:49 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5ae091a8-7ab9-4301-8ca3-d09cec6508cb Sep 04 15:55:49 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:49 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9ebf6c73-d6a4-48bc-a35e-5569b5f6b771 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0.7894fe80-8cf1-47cb-9e8d-71f4229d7a5d" returned: 0 in 0.506s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-9ebf6c73-d6a4-48bc-a35e-5569b5f6b771 tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-7894fe80-8cf1-47cb-9e8d-71f4229d7a5d" released by "_delete_snapshot" :: held 2.198s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-9ebf6c73-d6a4-48bc-a35e-5569b5f6b771 tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-da4415ad-d85c-496d-a0a1-a7b39f14a1a0" released by "delete_snapshot" :: held 2.227s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:50 devstack cinder-volume[87490]: WARNING cinder.quota [None req-9ebf6c73-d6a4-48bc-a35e-5569b5f6b771 tempest-GroupSnapshotsTest-720540587 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1900743928 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1900743928, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:55:50 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-9ebf6c73-d6a4-48bc-a35e-5569b5f6b771 tempest-GroupSnapshotsTest-720540587 None] Created reservations ['be887532-6c5e-4c06-9929-d8df1b7474d5', '0f33ea2c-2772-4a61-8bc8-db02425f8747', '00ce1346-36fc-43a4-bb06-f63ce794614b', '9b838274-96a3-49b6-a6da-6811e3e760e3'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:55:50 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-9ebf6c73-d6a4-48bc-a35e-5569b5f6b771 tempest-GroupSnapshotsTest-720540587 None] group_snapshot 986dafc9-5a1f-405b-a60a-5ec7973067f9: deleted successfully Sep 04 15:55:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-88a4d621-7adc-45c1-877e-be2a8d3ac318 tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "cinder-quobyte-da4415ad-d85c-496d-a0a1-a7b39f14a1a0" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-88a4d621-7adc-45c1-877e-be2a8d3ac318 tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-da4415ad-d85c-496d-a0a1-a7b39f14a1a0" acquired by "delete_volume" :: waited 0.052s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:52 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[11aa3426-2711-43c7-8e6c-faba5c03e6ec]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-88a4d621-7adc-45c1-877e-be2a8d3ac318 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:52 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0 Sep 04 15:55:52 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:53 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-88a4d621-7adc-45c1-877e-be2a8d3ac318 tempest-GroupSnapshotsTest-720540587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0" returned: 0 in 0.825s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-88a4d621-7adc-45c1-877e-be2a8d3ac318 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:53 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0 Sep 04 15:55:53 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:54 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-88a4d621-7adc-45c1-877e-be2a8d3ac318 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-da4415ad-d85c-496d-a0a1-a7b39f14a1a0" returned: 0 in 0.768s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-88a4d621-7adc-45c1-877e-be2a8d3ac318 tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-da4415ad-d85c-496d-a0a1-a7b39f14a1a0" released by "delete_volume" :: held 1.769s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:54 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-88a4d621-7adc-45c1-877e-be2a8d3ac318 tempest-GroupSnapshotsTest-720540587 None] Created reservations ['ddd7750f-6475-4b06-98ad-94dde0779805'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:55:54 devstack cinder-volume[87490]: WARNING cinder.db.api [None req-88a4d621-7adc-45c1-877e-be2a8d3ac318 tempest-GroupSnapshotsTest-720540587 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1900743928'] Sep 04 15:55:54 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-88a4d621-7adc-45c1-877e-be2a8d3ac318 tempest-GroupSnapshotsTest-720540587 None] Created reservations ['a338a228-b9b4-48c5-8a61-ffafa4f01338', '0013521b-b7e0-41b5-a0f9-5d47236aa501', '05074f48-5b4a-4f19-b1bb-94e3f3e92374', 'de1f18e0-1501-411c-b22a-a2a2a8a0ac61'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:55:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-88a4d621-7adc-45c1-877e-be2a8d3ac318 tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-88a4d621-7adc-45c1-877e-be2a8d3ac318 tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-88a4d621-7adc-45c1-877e-be2a8d3ac318 tempest-GroupSnapshotsTest-720540587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:55:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-88a4d621-7adc-45c1-877e-be2a8d3ac318 tempest-GroupSnapshotsTest-720540587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:55:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-88a4d621-7adc-45c1-877e-be2a8d3ac318 tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-88a4d621-7adc-45c1-877e-be2a8d3ac318 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:54 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:55:54 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:55 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-88a4d621-7adc-45c1-877e-be2a8d3ac318 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.628s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:55 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-88a4d621-7adc-45c1-877e-be2a8d3ac318 tempest-GroupSnapshotsTest-720540587 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:55:55 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-88a4d621-7adc-45c1-877e-be2a8d3ac318 tempest-GroupSnapshotsTest-720540587 None] Delete group completed successfully. Sep 04 15:55:56 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5ae091a8-7ab9-4301-8ca3-d09cec6508cb" returned: 0 in 6.604s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:56 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7, size 1024.00 MB, duration 6.60 sec, destination /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5ae091a8-7ab9-4301-8ca3-d09cec6508cb {{(pid=87490) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 15:55:56 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Converted 1024.00 MB image at 155.04 MB/s Sep 04 15:55:56 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5ae091a8-7ab9-4301-8ca3-d09cec6508cb is being set with open permissions: ugo+rw: NotImplementedError Sep 04 15:55:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5ae091a8-7ab9-4301-8ca3-d09cec6508cb {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:56 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5ae091a8-7ab9-4301-8ca3-d09cec6508cb Sep 04 15:55:56 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:56 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5ae091a8-7ab9-4301-8ca3-d09cec6508cb" returned: 0 in 0.298s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Lock "cinder-quobyte-5ae091a8-7ab9-4301-8ca3-d09cec6508cb" released by "_copy_volume_from_snapshot" :: held 8.097s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:56 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-8992b2b0-288d-4410-b376-4e06a8d61794 tempest-GroupSnapshotsTest-720540587 None] Group tempest-GroupSnapshotsTest-Group-1918934350: creating Sep 04 15:55:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Acquiring lock "cinder-quobyte-b4ac2c75-2cc4-495b-8850-6561a0eb4e0c" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:55:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Lock "cinder-quobyte-b4ac2c75-2cc4-495b-8850-6561a0eb4e0c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:55:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Deleting offline snapshot b4ac2c75-2cc4-495b-8850-6561a0eb4e0c of volume 479e8c4f-f195-41fc-8c93-25b8ddc039d7 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:55:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] snapshot_file for this snap is: volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.b4ac2c75-2cc4-495b-8850-6561a0eb4e0c {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:55:56 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac25ad0b-e2f4-4d43-a5fc-2859791fc723]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.b4ac2c75-2cc4-495b-8850-6561a0eb4e0c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:56 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-8992b2b0-288d-4410-b376-4e06a8d61794 tempest-GroupSnapshotsTest-720540587 None] Group tempest-GroupSnapshotsTest-Group-1918934350: created successfully Sep 04 15:55:56 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-8992b2b0-288d-4410-b376-4e06a8d61794 tempest-GroupSnapshotsTest-720540587 None] Create group completed successfully. Sep 04 15:55:56 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.b4ac2c75-2cc4-495b-8850-6561a0eb4e0c Sep 04 15:55:56 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:57 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.b4ac2c75-2cc4-495b-8850-6561a0eb4e0c" returned: 0 in 0.437s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:55:57 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[747e06e2-fa79-4006-a0d6-33fedaee8832]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:55:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:57 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7 Sep 04 15:55:57 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:57 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7" returned: 0 in 0.736s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.b4ac2c75-2cc4-495b-8850-6561a0eb4e0c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:57 devstack sudo[97143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.b4ac2c75-2cc4-495b-8850-6561a0eb4e0c Sep 04 15:55:57 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:58 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:55:58 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Flow 'volume_create_manager' (ec015794-7b16-4964-8d51-f80d5d6de4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e0ecd06-e11c-4aa1-8895-895bfbfcb968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.b4ac2c75-2cc4-495b-8850-6561a0eb4e0c" returned: 0 in 0.690s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.b4ac2c75-2cc4-495b-8850-6561a0eb4e0c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:58 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.b4ac2c75-2cc4-495b-8850-6561a0eb4e0c Sep 04 15:55:58 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e0ecd06-e11c-4aa1-8895-895bfbfcb968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1665379074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91b4e413-8fbf-4da8-b884-2ea147be5413,host='devstack@QuobyteHD#QuobyteHD',id=fd2d504a-2e39-48d7-89bf-eceabafa8ca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf6533eb8f14487aa6ff16635e4f8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:58Z,use_quota=True,user_id='5f124db038e44042953cac40ebd39681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71274c11-4f45-4fb4-afbf-6be27c887818),volume_type_id=71274c11-4f45-4fb4-afbf-6be27c887818)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea46f1a-8fe4-432f-9022-0200f54bc164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea46f1a-8fe4-432f-9022-0200f54bc164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e73efed-be21-4583-b0ec-74d397576cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e73efed-be21-4583-b0ec-74d397576cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd2d504a-2e39-48d7-89bf-eceabafa8ca0', 'volume_name': 'volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07ea0884-1779-4aa3-97f1-fe63729c2ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07ea0884-1779-4aa3-97f1-fe63729c2ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53832ab0-51e5-4d13-bb7f-656a7433cfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:58 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Volume fd2d504a-2e39-48d7-89bf-eceabafa8ca0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0', 'volume_size': 1} Sep 04 15:55:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:58 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7.b4ac2c75-2cc4-495b-8850-6561a0eb4e0c" returned: 0 in 0.347s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:58 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Lock "cinder-quobyte-b4ac2c75-2cc4-495b-8850-6561a0eb4e0c" released by "_delete_snapshot" :: held 2.334s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:55:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.215s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.319s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=91b4e413-8fbf-4da8-b884-2ea147be5413,created_at=2026-09-04T13:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1665379074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91b4e413-8fbf-4da8-b884-2ea147be5413,host='devstack@QuobyteHD#QuobyteHD',id=fd2d504a-2e39-48d7-89bf-eceabafa8ca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf6533eb8f14487aa6ff16635e4f8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:55:58Z,use_quota=True,user_id='5f124db038e44042953cac40ebd39681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71274c11-4f45-4fb4-afbf-6be27c887818),volume_type_id=71274c11-4f45-4fb4-afbf-6be27c887818)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:55:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Creating volume fd2d504a-2e39-48d7-89bf-eceabafa8ca0 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:55:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:55:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:55:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:55:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:55:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:55:58 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:55:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:58 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0 1073741824 Sep 04 15:55:58 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:59 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-23bc0842-ba1f-4586-8b27-3caa622b996f tempest-GroupsV314Test-585939586 None] Create group from source-group-db7d5475-8ec1-45ef-bdbf-cb9cc8c49892 completed successfully. Sep 04 15:55:59 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0 1073741824" returned: 0 in 0.527s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:55:59 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0 Sep 04 15:55:59 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:55:59 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Sep 04 15:55:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0" returned: 0 in 0.317s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:55:59 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:55:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:55:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53832ab0-51e5-4d13-bb7f-656a7433cfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f2c0134-55a9-494f-a5bb-5fda5ceed354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:55:59 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Volume volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0 (fd2d504a-2e39-48d7-89bf-eceabafa8ca0): created successfully Sep 04 15:55:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f2c0134-55a9-494f-a5bb-5fda5ceed354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:55:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Flow 'volume_create_manager' (ec015794-7b16-4964-8d51-f80d5d6de4f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:55:59 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-9203efe7-cbf8-445e-aa17-b18ac3a1af9d tempest-GroupSnapshotsTest-720540587 None] Created volume successfully. Sep 04 15:56:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e5db29dd-0da6-4df9-af47-9dc7f4f70475 tempest-GroupsV314Test-585939586 None] Acquiring lock "cinder-quobyte-5ae091a8-7ab9-4301-8ca3-d09cec6508cb" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e5db29dd-0da6-4df9-af47-9dc7f4f70475 tempest-GroupsV314Test-585939586 None] Lock "cinder-quobyte-5ae091a8-7ab9-4301-8ca3-d09cec6508cb" acquired by "delete_volume" :: waited 0.024s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:00 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4002f20-41fe-47ae-ab28-e30272262ea0]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e5db29dd-0da6-4df9-af47-9dc7f4f70475 tempest-GroupsV314Test-585939586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5ae091a8-7ab9-4301-8ca3-d09cec6508cb {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:00 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5ae091a8-7ab9-4301-8ca3-d09cec6508cb Sep 04 15:56:00 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:01 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e5db29dd-0da6-4df9-af47-9dc7f4f70475 tempest-GroupsV314Test-585939586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5ae091a8-7ab9-4301-8ca3-d09cec6508cb" returned: 0 in 0.585s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e5db29dd-0da6-4df9-af47-9dc7f4f70475 tempest-GroupsV314Test-585939586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5ae091a8-7ab9-4301-8ca3-d09cec6508cb {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:01 devstack sudo[97167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5ae091a8-7ab9-4301-8ca3-d09cec6508cb Sep 04 15:56:01 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:01 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e5db29dd-0da6-4df9-af47-9dc7f4f70475 tempest-GroupsV314Test-585939586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5ae091a8-7ab9-4301-8ca3-d09cec6508cb" returned: 0 in 0.435s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e5db29dd-0da6-4df9-af47-9dc7f4f70475 tempest-GroupsV314Test-585939586 None] Lock "cinder-quobyte-5ae091a8-7ab9-4301-8ca3-d09cec6508cb" released by "delete_volume" :: held 1.096s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:01 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-e5db29dd-0da6-4df9-af47-9dc7f4f70475 tempest-GroupsV314Test-585939586 None] Created reservations ['3dbda8c6-50ff-4ffe-9ac0-aa9dbba8c1b0'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:56:01 devstack cinder-volume[87490]: WARNING cinder.quota [None req-e5db29dd-0da6-4df9-af47-9dc7f4f70475 tempest-GroupsV314Test-585939586 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1246520930 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1246520930, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:56:01 devstack cinder-volume[87490]: WARNING cinder.quota [None req-e5db29dd-0da6-4df9-af47-9dc7f4f70475 tempest-GroupsV314Test-585939586 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1246520930 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1246520930, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:56:01 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-e5db29dd-0da6-4df9-af47-9dc7f4f70475 tempest-GroupsV314Test-585939586 None] Created reservations ['7429fcae-9a75-4203-83bd-9ce5538b8c00', 'a90607ad-25dc-49f1-9660-0e860c62a267', '6ea8ab36-ab22-4b17-989f-d3c8b0ce5cf8', '9ad2ff65-a97f-4b4a-bb27-0a397e7080ba'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:56:01 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:56:01 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Flow 'volume_create_manager' (96d80a01-eaec-4d69-ab1f-260876b0e32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:56:01 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc4ef76-96cb-4b10-9c05-ec32583204a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:01 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc4ef76-96cb-4b10-9c05-ec32583204a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-546755342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91b4e413-8fbf-4da8-b884-2ea147be5413,host='devstack@QuobyteHD#QuobyteHD',id=50faac7f-9b03-4e01-918d-00bf6e0e6810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf6533eb8f14487aa6ff16635e4f8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:02Z,use_quota=True,user_id='5f124db038e44042953cac40ebd39681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71274c11-4f45-4fb4-afbf-6be27c887818),volume_type_id=71274c11-4f45-4fb4-afbf-6be27c887818)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:01 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726916f0-4e56-434b-95f0-8e63ca26c051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:01 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726916f0-4e56-434b-95f0-8e63ca26c051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:01 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e75902-e19d-4edd-96b5-06b6adc2e39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:01 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e75902-e19d-4edd-96b5-06b6adc2e39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50faac7f-9b03-4e01-918d-00bf6e0e6810', 'volume_name': 'volume-50faac7f-9b03-4e01-918d-00bf6e0e6810', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:01 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a68b6b1-8d62-4f76-8bf3-36943e9f93f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:01 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a68b6b1-8d62-4f76-8bf3-36943e9f93f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:01 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae1ee0e-9f79-4147-8577-daa0393e0c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:01 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Volume 50faac7f-9b03-4e01-918d-00bf6e0e6810: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50faac7f-9b03-4e01-918d-00bf6e0e6810', 'volume_size': 1} Sep 04 15:56:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:01 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=91b4e413-8fbf-4da8-b884-2ea147be5413,created_at=2026-09-04T13:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-546755342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91b4e413-8fbf-4da8-b884-2ea147be5413,host='devstack@QuobyteHD#QuobyteHD',id=50faac7f-9b03-4e01-918d-00bf6e0e6810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf6533eb8f14487aa6ff16635e4f8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:02Z,use_quota=True,user_id='5f124db038e44042953cac40ebd39681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71274c11-4f45-4fb4-afbf-6be27c887818),volume_type_id=71274c11-4f45-4fb4-afbf-6be27c887818)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:56:01 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Creating volume 50faac7f-9b03-4e01-918d-00bf6e0e6810 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:56:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:01 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:56:02 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:56:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:02 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:56:02 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:56:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:02 devstack sudo[97170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810 1073741824 Sep 04 15:56:02 devstack sudo[97170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e5db29dd-0da6-4df9-af47-9dc7f4f70475 tempest-GroupsV314Test-585939586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e5db29dd-0da6-4df9-af47-9dc7f4f70475 tempest-GroupsV314Test-585939586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:02 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e5db29dd-0da6-4df9-af47-9dc7f4f70475 tempest-GroupsV314Test-585939586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:56:02 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e5db29dd-0da6-4df9-af47-9dc7f4f70475 tempest-GroupsV314Test-585939586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:56:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e5db29dd-0da6-4df9-af47-9dc7f4f70475 tempest-GroupsV314Test-585939586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e5db29dd-0da6-4df9-af47-9dc7f4f70475 tempest-GroupsV314Test-585939586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:02 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:56:02 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:02 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e5db29dd-0da6-4df9-af47-9dc7f4f70475 tempest-GroupsV314Test-585939586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.303s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:02 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-e5db29dd-0da6-4df9-af47-9dc7f4f70475 tempest-GroupsV314Test-585939586 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:56:02 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-e5db29dd-0da6-4df9-af47-9dc7f4f70475 tempest-GroupsV314Test-585939586 None] Delete group completed successfully. Sep 04 15:56:02 devstack sudo[97170]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810 1073741824" returned: 0 in 0.509s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:02 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810 Sep 04 15:56:02 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:02 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810" returned: 0 in 0.276s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:02 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:56:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae1ee0e-9f79-4147-8577-daa0393e0c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50faac7f-9b03-4e01-918d-00bf6e0e6810', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c815f112-baea-41c8-8e5e-6a8e7dca4147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:02 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Volume volume-50faac7f-9b03-4e01-918d-00bf6e0e6810 (50faac7f-9b03-4e01-918d-00bf6e0e6810): created successfully Sep 04 15:56:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c815f112-baea-41c8-8e5e-6a8e7dca4147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Flow 'volume_create_manager' (96d80a01-eaec-4d69-ab1f-260876b0e32f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:56:02 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-2e03c843-6ac5-40a8-8bf1-5a181e1d46dd tempest-GroupSnapshotsTest-720540587 None] Created volume successfully. Sep 04 15:56:03 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-46d7194d-ccbb-4616-b5ed-c9b216386368 tempest-GroupSnapshotsTest-720540587 None] Update group completed successfully. Sep 04 15:56:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-601ef4d3-596c-4dba-bf49-a48fc441a249 tempest-GroupsV314Test-585939586 None] Acquiring lock "cinder-quobyte-479e8c4f-f195-41fc-8c93-25b8ddc039d7" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-601ef4d3-596c-4dba-bf49-a48fc441a249 tempest-GroupsV314Test-585939586 None] Lock "cinder-quobyte-479e8c4f-f195-41fc-8c93-25b8ddc039d7" acquired by "delete_volume" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:03 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e8b238-8239-4e13-9eae-b5bb9ea048b2]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-601ef4d3-596c-4dba-bf49-a48fc441a249 tempest-GroupsV314Test-585939586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:03 devstack sudo[97183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7 Sep 04 15:56:03 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:03 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:56:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Flow 'volume_create_manager' (f6e29696-b429-40ad-a92a-3e2551853500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:56:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22bbc926-4c11-466c-9a68-f2fb967a2ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22bbc926-4c11-466c-9a68-f2fb967a2ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1436527403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e61de4-fcf9-42fe-bcac-0005d4856794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbddb9fa7cf4d2e9e7f040f09933513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:04Z,use_quota=True,user_id='60e06216c28b47909ed1ebf12c471a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb7baaf-9bd4-4072-853a-b4610f30b43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb7baaf-9bd4-4072-853a-b4610f30b43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ab6ef7-a6c1-4816-b81b-7d08affb4d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ab6ef7-a6c1-4816-b81b-7d08affb4d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34e61de4-fcf9-42fe-bcac-0005d4856794', 'volume_name': 'volume-34e61de4-fcf9-42fe-bcac-0005d4856794', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f580faf-93c5-43c6-b545-ab323276f26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f580faf-93c5-43c6-b545-ab323276f26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ee3219-cc69-452d-9831-0d179de63491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:04 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Volume 34e61de4-fcf9-42fe-bcac-0005d4856794: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34e61de4-fcf9-42fe-bcac-0005d4856794', 'volume_size': 1} Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1436527403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e61de4-fcf9-42fe-bcac-0005d4856794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdbddb9fa7cf4d2e9e7f040f09933513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:04Z,use_quota=True,user_id='60e06216c28b47909ed1ebf12c471a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Creating volume 34e61de4-fcf9-42fe-bcac-0005d4856794 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:56:04 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-34e61de4-fcf9-42fe-bcac-0005d4856794 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:04 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-ab72a952-46b4-4c37-a2cf-064555caac69 tempest-GroupSnapshotsTest-720540587 None] Update group completed successfully. Sep 04 15:56:04 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-34e61de4-fcf9-42fe-bcac-0005d4856794 1073741824 Sep 04 15:56:04 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:04 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-601ef4d3-596c-4dba-bf49-a48fc441a249 tempest-GroupsV314Test-585939586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7" returned: 0 in 0.544s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-601ef4d3-596c-4dba-bf49-a48fc441a249 tempest-GroupsV314Test-585939586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:04 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7 Sep 04 15:56:04 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:04 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-601ef4d3-596c-4dba-bf49-a48fc441a249 tempest-GroupsV314Test-585939586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-479e8c4f-f195-41fc-8c93-25b8ddc039d7" returned: 0 in 0.297s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-601ef4d3-596c-4dba-bf49-a48fc441a249 tempest-GroupsV314Test-585939586 None] Lock "cinder-quobyte-479e8c4f-f195-41fc-8c93-25b8ddc039d7" released by "delete_volume" :: held 0.940s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-601ef4d3-596c-4dba-bf49-a48fc441a249 tempest-GroupsV314Test-585939586 None] Created reservations ['0f3b878b-8d68-49c7-8cc6-4b99a80d7cd3'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-601ef4d3-596c-4dba-bf49-a48fc441a249 tempest-GroupsV314Test-585939586 None] Created reservations ['bdcee18f-4d7d-4bca-8c9f-6af2e359c1ac', '06ff8ac6-27db-4b88-9a26-d4ffcdafcc23', '68b745d5-0cc6-45ec-8a54-29094c6c528e', '080fb207-fe5b-41c2-bf5a-294809b8f114'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:56:04 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-34e61de4-fcf9-42fe-bcac-0005d4856794 1073741824" returned: 0 in 0.537s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-34e61de4-fcf9-42fe-bcac-0005d4856794 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:04 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-34e61de4-fcf9-42fe-bcac-0005d4856794 Sep 04 15:56:04 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-601ef4d3-596c-4dba-bf49-a48fc441a249 tempest-GroupsV314Test-585939586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-601ef4d3-596c-4dba-bf49-a48fc441a249 tempest-GroupsV314Test-585939586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-601ef4d3-596c-4dba-bf49-a48fc441a249 tempest-GroupsV314Test-585939586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-601ef4d3-596c-4dba-bf49-a48fc441a249 tempest-GroupsV314Test-585939586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-601ef4d3-596c-4dba-bf49-a48fc441a249 tempest-GroupsV314Test-585939586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-601ef4d3-596c-4dba-bf49-a48fc441a249 tempest-GroupsV314Test-585939586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:04 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:56:04 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:04 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-34e61de4-fcf9-42fe-bcac-0005d4856794" returned: 0 in 0.321s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ee3219-cc69-452d-9831-0d179de63491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34e61de4-fcf9-42fe-bcac-0005d4856794', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:05 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791e7ff9-6b42-4f27-af82-352c6494f3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:05 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Volume volume-34e61de4-fcf9-42fe-bcac-0005d4856794 (34e61de4-fcf9-42fe-bcac-0005d4856794): created successfully Sep 04 15:56:05 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791e7ff9-6b42-4f27-af82-352c6494f3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:05 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Flow 'volume_create_manager' (f6e29696-b429-40ad-a92a-3e2551853500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:56:05 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-b3063eae-ff64-4c16-9a8c-24abe179905d tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Created volume successfully. Sep 04 15:56:05 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-601ef4d3-596c-4dba-bf49-a48fc441a249 tempest-GroupsV314Test-585939586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.412s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:05 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-601ef4d3-596c-4dba-bf49-a48fc441a249 tempest-GroupsV314Test-585939586 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:56:05 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-374bd445-4c15-4028-9c26-e285574ae22b tempest-GroupSnapshotsTest-720540587 None] Update group completed successfully. Sep 04 15:56:05 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-601ef4d3-596c-4dba-bf49-a48fc441a249 tempest-GroupsV314Test-585939586 None] Delete group completed successfully. Sep 04 15:56:06 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-df9c83d6-456c-4969-b951-a2f18b0b022a tempest-GroupSnapshotsTest-720540587 None] Update group completed successfully. Sep 04 15:56:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2400b822-a0ff-471f-b87c-caf8d0f92d20 tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Acquiring lock "cinder-34e61de4-fcf9-42fe-bcac-0005d4856794-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2400b822-a0ff-471f-b87c-caf8d0f92d20 tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Lock "cinder-34e61de4-fcf9-42fe-bcac-0005d4856794-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2400b822-a0ff-471f-b87c-caf8d0f92d20 tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Acquiring lock "cinder-quobyte-34e61de4-fcf9-42fe-bcac-0005d4856794" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2400b822-a0ff-471f-b87c-caf8d0f92d20 tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Lock "cinder-quobyte-34e61de4-fcf9-42fe-bcac-0005d4856794" acquired by "delete_volume" :: waited 0.026s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:07 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[49760950-2e02-4db7-a833-6d27c402e91e]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2400b822-a0ff-471f-b87c-caf8d0f92d20 tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-34e61de4-fcf9-42fe-bcac-0005d4856794 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:07 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-34e61de4-fcf9-42fe-bcac-0005d4856794 Sep 04 15:56:07 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:07 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2400b822-a0ff-471f-b87c-caf8d0f92d20 tempest-VolumeQuotasNegativeTestJSON-1217684423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-34e61de4-fcf9-42fe-bcac-0005d4856794" returned: 0 in 0.510s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2400b822-a0ff-471f-b87c-caf8d0f92d20 tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-34e61de4-fcf9-42fe-bcac-0005d4856794 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:07 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-34e61de4-fcf9-42fe-bcac-0005d4856794 Sep 04 15:56:07 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:08 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] GroupSnapshot 987eb847-c531-4e23-87a8-8b3b60cdfe8a: creating. Sep 04 15:56:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] Group snapshot 987eb847-c531-4e23-87a8-8b3b60cdfe8a: creating. {{(pid=87490) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 04 15:56:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:08 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] Creating offline snapshot 214180b6-a1da-4eca-98b1-79220e49eba7 of volume fd2d504a-2e39-48d7-89bf-eceabafa8ca0 {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:56:08 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bbb8e9-ecef-4a66-9e58-d38b6cecdb6b]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:08 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2400b822-a0ff-471f-b87c-caf8d0f92d20 tempest-VolumeQuotasNegativeTestJSON-1217684423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-34e61de4-fcf9-42fe-bcac-0005d4856794" returned: 0 in 0.379s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:08 devstack sudo[97211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0 Sep 04 15:56:08 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:08 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2400b822-a0ff-471f-b87c-caf8d0f92d20 tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Lock "cinder-quobyte-34e61de4-fcf9-42fe-bcac-0005d4856794" released by "delete_volume" :: held 0.958s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:08 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-2400b822-a0ff-471f-b87c-caf8d0f92d20 tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Created reservations ['bdb39c59-c265-4a22-8e6e-7d8bad523dcc', '154856c2-e1ad-4d9a-9d48-4c3f2c684d2b', 'c0bdc2bd-c6c8-4c7c-8467-aeaa78458ab6', 'e48094a7-ea61-4d30-915c-a61c3c3d1a52'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:56:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2400b822-a0ff-471f-b87c-caf8d0f92d20 tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2400b822-a0ff-471f-b87c-caf8d0f92d20 tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:08 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2400b822-a0ff-471f-b87c-caf8d0f92d20 tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:56:08 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2400b822-a0ff-471f-b87c-caf8d0f92d20 tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:56:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2400b822-a0ff-471f-b87c-caf8d0f92d20 tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2400b822-a0ff-471f-b87c-caf8d0f92d20 tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:08 devstack sudo[97214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:56:08 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:08 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0" returned: 0 in 0.535s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0.214180b6-a1da-4eca-98b1-79220e49eba7 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:08 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0.214180b6-a1da-4eca-98b1-79220e49eba7 1G Sep 04 15:56:08 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:08 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2400b822-a0ff-471f-b87c-caf8d0f92d20 tempest-VolumeQuotasNegativeTestJSON-1217684423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.350s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:08 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-2400b822-a0ff-471f-b87c-caf8d0f92d20 tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:56:08 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-2400b822-a0ff-471f-b87c-caf8d0f92d20 tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Deleted volume successfully. Sep 04 15:56:08 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2400b822-a0ff-471f-b87c-caf8d0f92d20 tempest-VolumeQuotasNegativeTestJSON-1217684423 None] Lock "cinder-34e61de4-fcf9-42fe-bcac-0005d4856794-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:09 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0.214180b6-a1da-4eca-98b1-79220e49eba7 1G" returned: 0 in 0.492s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0.214180b6-a1da-4eca-98b1-79220e49eba7 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:09 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0.214180b6-a1da-4eca-98b1-79220e49eba7 Sep 04 15:56:09 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:09 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0.214180b6-a1da-4eca-98b1-79220e49eba7" returned: 0 in 0.373s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:09 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0.214180b6-a1da-4eca-98b1-79220e49eba7 is being set with open permissions: ugo+rw: NotImplementedError Sep 04 15:56:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0.214180b6-a1da-4eca-98b1-79220e49eba7 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:09 devstack sudo[97231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0.214180b6-a1da-4eca-98b1-79220e49eba7 Sep 04 15:56:09 devstack sudo[97231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:09 devstack sudo[97231]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0.214180b6-a1da-4eca-98b1-79220e49eba7" returned: 0 in 0.285s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:09 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0.info Sep 04 15:56:09 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:10 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0.info" returned: 0 in 0.320s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:10 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 15:56:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:10 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0.info Sep 04 15:56:10 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:10 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0.info" returned: 0 in 0.326s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.460s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] Creating offline snapshot 94b050e0-85fe-4332-a516-e2dd016784bd of volume 50faac7f-9b03-4e01-918d-00bf6e0e6810 {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:56:10 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfceaf6a-e12b-4559-ad39-beff733f5102]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:10 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810 Sep 04 15:56:10 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:11 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810" returned: 0 in 0.540s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810.94b050e0-85fe-4332-a516-e2dd016784bd 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:11 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810.94b050e0-85fe-4332-a516-e2dd016784bd 1G Sep 04 15:56:11 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:11 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810.94b050e0-85fe-4332-a516-e2dd016784bd 1G" returned: 0 in 0.615s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50faac7f-9b03-4e01-918d-00bf6e0e6810 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810.94b050e0-85fe-4332-a516-e2dd016784bd {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:11 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50faac7f-9b03-4e01-918d-00bf6e0e6810 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810.94b050e0-85fe-4332-a516-e2dd016784bd Sep 04 15:56:11 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:12 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50faac7f-9b03-4e01-918d-00bf6e0e6810 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810.94b050e0-85fe-4332-a516-e2dd016784bd" returned: 0 in 0.367s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:12 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810.94b050e0-85fe-4332-a516-e2dd016784bd is being set with open permissions: ugo+rw: NotImplementedError Sep 04 15:56:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810.94b050e0-85fe-4332-a516-e2dd016784bd {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:12 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810.94b050e0-85fe-4332-a516-e2dd016784bd Sep 04 15:56:12 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:12 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810.94b050e0-85fe-4332-a516-e2dd016784bd" returned: 0 in 0.317s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:12 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810.info Sep 04 15:56:12 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:12 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810.info" returned: 0 in 0.389s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:12 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 15:56:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:12 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810.info Sep 04 15:56:12 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:13 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810.info" returned: 0 in 0.338s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.700s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:13 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-7be8506e-c909-4c71-9096-811063fc79c8 tempest-GroupSnapshotsTest-720540587 None] group_snapshot 987eb847-c531-4e23-87a8-8b3b60cdfe8a: created successfully Sep 04 15:56:14 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] group_snapshot 987eb847-c531-4e23-87a8-8b3b60cdfe8a: deleting Sep 04 15:56:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] group_snapshot 987eb847-c531-4e23-87a8-8b3b60cdfe8a: deleting {{(pid=87490) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 04 15:56:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "cinder-quobyte-fd2d504a-2e39-48d7-89bf-eceabafa8ca0" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-fd2d504a-2e39-48d7-89bf-eceabafa8ca0" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "cinder-quobyte-214180b6-a1da-4eca-98b1-79220e49eba7" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-214180b6-a1da-4eca-98b1-79220e49eba7" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Deleting offline snapshot 214180b6-a1da-4eca-98b1-79220e49eba7 of volume fd2d504a-2e39-48d7-89bf-eceabafa8ca0 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:56:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] snapshot_file for this snap is: volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0.214180b6-a1da-4eca-98b1-79220e49eba7 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:56:14 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6bb3da-24b4-4930-b071-438cf0232c49]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0.214180b6-a1da-4eca-98b1-79220e49eba7 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:15 devstack sudo[97265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0.214180b6-a1da-4eca-98b1-79220e49eba7 Sep 04 15:56:15 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:15 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0.214180b6-a1da-4eca-98b1-79220e49eba7" returned: 0 in 0.539s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:15 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:56:15 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2c44f0-a485-48fb-b910-8137f1b6fa89]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:15 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0 Sep 04 15:56:15 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:15 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0" returned: 0 in 0.511s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0.214180b6-a1da-4eca-98b1-79220e49eba7 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:16 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0.214180b6-a1da-4eca-98b1-79220e49eba7 Sep 04 15:56:16 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:16 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0.214180b6-a1da-4eca-98b1-79220e49eba7" returned: 0 in 0.431s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0.214180b6-a1da-4eca-98b1-79220e49eba7 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:16 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0.214180b6-a1da-4eca-98b1-79220e49eba7 Sep 04 15:56:16 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:16 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0.214180b6-a1da-4eca-98b1-79220e49eba7" returned: 0 in 0.327s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-214180b6-a1da-4eca-98b1-79220e49eba7" released by "_delete_snapshot" :: held 1.978s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-fd2d504a-2e39-48d7-89bf-eceabafa8ca0" released by "delete_snapshot" :: held 2.011s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "cinder-quobyte-50faac7f-9b03-4e01-918d-00bf6e0e6810" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-50faac7f-9b03-4e01-918d-00bf6e0e6810" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "cinder-quobyte-94b050e0-85fe-4332-a516-e2dd016784bd" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-94b050e0-85fe-4332-a516-e2dd016784bd" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Deleting offline snapshot 94b050e0-85fe-4332-a516-e2dd016784bd of volume 50faac7f-9b03-4e01-918d-00bf6e0e6810 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:56:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] snapshot_file for this snap is: volume-50faac7f-9b03-4e01-918d-00bf6e0e6810.94b050e0-85fe-4332-a516-e2dd016784bd {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:56:16 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfc5136-8919-45a8-bfa6-c15e90b30a0b]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810.94b050e0-85fe-4332-a516-e2dd016784bd {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:17 devstack sudo[97285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810.94b050e0-85fe-4332-a516-e2dd016784bd Sep 04 15:56:17 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:17 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810.94b050e0-85fe-4332-a516-e2dd016784bd" returned: 0 in 0.476s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:17 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50faac7f-9b03-4e01-918d-00bf6e0e6810(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:56:17 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a16504-3665-4e72-838d-09d59ca9f8f0]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:17 devstack sudo[97290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810 Sep 04 15:56:17 devstack sudo[97290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:17 devstack sudo[97290]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810" returned: 0 in 0.484s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810.94b050e0-85fe-4332-a516-e2dd016784bd {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:17 devstack sudo[97295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810.94b050e0-85fe-4332-a516-e2dd016784bd Sep 04 15:56:17 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Flow 'volume_create_manager' (a895f0ab-347c-4fe0-88e8-b9bf34e4f21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58218e1c-e57d-4060-9ae5-3c1b5c5971c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58218e1c-e57d-4060-9ae5-3c1b5c5971c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1198602786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93b8ebdc-587f-46c8-ae74-d3c164814862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6456346045ea48f7992bf0ffac94f892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:18Z,use_quota=True,user_id='d53c333d48504ab5a1354cc97cc6d3fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24baaf92-4a52-4d1e-9ca2-d4f3cef80b52),volume_type_id=24baaf92-4a52-4d1e-9ca2-d4f3cef80b52)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee423766-526a-4bee-9945-109a0946b03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee423766-526a-4bee-9945-109a0946b03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (861f41f1-39f2-41fe-adc0-e60217ab5730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (861f41f1-39f2-41fe-adc0-e60217ab5730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93b8ebdc-587f-46c8-ae74-d3c164814862', 'volume_name': 'volume-93b8ebdc-587f-46c8-ae74-d3c164814862', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72651b29-0745-4706-abe9-c93ea6832b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72651b29-0745-4706-abe9-c93ea6832b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a82902-d1ba-4b8c-8879-3bff44e42936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:18 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Volume 93b8ebdc-587f-46c8-ae74-d3c164814862: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93b8ebdc-587f-46c8-ae74-d3c164814862', 'volume_size': 1} Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1198602786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93b8ebdc-587f-46c8-ae74-d3c164814862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6456346045ea48f7992bf0ffac94f892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:18Z,use_quota=True,user_id='d53c333d48504ab5a1354cc97cc6d3fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24baaf92-4a52-4d1e-9ca2-d4f3cef80b52),volume_type_id=24baaf92-4a52-4d1e-9ca2-d4f3cef80b52)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Creating volume 93b8ebdc-587f-46c8-ae74-d3c164814862 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:56:18 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-93b8ebdc-587f-46c8-ae74-d3c164814862 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:18 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-93b8ebdc-587f-46c8-ae74-d3c164814862 1073741824 Sep 04 15:56:18 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:18 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810.94b050e0-85fe-4332-a516-e2dd016784bd" returned: 0 in 0.404s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810.94b050e0-85fe-4332-a516-e2dd016784bd {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:18 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810.94b050e0-85fe-4332-a516-e2dd016784bd Sep 04 15:56:18 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:18 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810.94b050e0-85fe-4332-a516-e2dd016784bd" returned: 0 in 0.298s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-94b050e0-85fe-4332-a516-e2dd016784bd" released by "_delete_snapshot" :: held 1.783s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-50faac7f-9b03-4e01-918d-00bf6e0e6810" released by "delete_snapshot" :: held 1.816s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:18 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-93b8ebdc-587f-46c8-ae74-d3c164814862 1073741824" returned: 0 in 0.520s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-93b8ebdc-587f-46c8-ae74-d3c164814862 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:18 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-93b8ebdc-587f-46c8-ae74-d3c164814862 Sep 04 15:56:18 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:18 devstack cinder-volume[87490]: WARNING cinder.quota [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1339942785 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1339942785, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:56:18 devstack cinder-volume[87490]: WARNING cinder.quota [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1339942785 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1339942785, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Created reservations ['11e3bbe9-e5c6-4ed1-abcf-dd09706fbad0', '3f9a2ed7-b530-4784-b34f-b94453423ef4', '293d1064-5b37-4e01-8392-3fa2d5c2785b', 'e6c06844-5e14-42f4-986c-af38306348e4'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:56:18 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] Created reservations ['c7d9f38d-e1d6-4c39-9da1-e3ae4a51e3a6', '22606eb4-2e54-4d9f-96e5-94da7d0151f7', 'f0017801-4031-4ce0-a9ed-f24cff87336d', '1809ed7c-0377-4f44-a1a7-7f6dbaf8e832'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:56:19 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-5ae71925-ae8c-4bb9-8dc1-d09c5a933f97 tempest-GroupSnapshotsTest-720540587 None] group_snapshot 987eb847-c531-4e23-87a8-8b3b60cdfe8a: deleted successfully Sep 04 15:56:19 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-93b8ebdc-587f-46c8-ae74-d3c164814862" returned: 0 in 0.313s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:56:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a82902-d1ba-4b8c-8879-3bff44e42936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93b8ebdc-587f-46c8-ae74-d3c164814862', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5322e632-e96e-433f-b7ac-02c6fcfb7137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:19 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Volume volume-93b8ebdc-587f-46c8-ae74-d3c164814862 (93b8ebdc-587f-46c8-ae74-d3c164814862): created successfully Sep 04 15:56:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5322e632-e96e-433f-b7ac-02c6fcfb7137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Flow 'volume_create_manager' (a895f0ab-347c-4fe0-88e8-b9bf34e4f21f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:56:19 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-dd549291-6660-4945-99c7-f7413d321f02 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Created volume successfully. Sep 04 15:56:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5f2f60f6-26e4-467d-8a7d-24f933dcd3fa tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "cinder-quobyte-50faac7f-9b03-4e01-918d-00bf6e0e6810" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5f2f60f6-26e4-467d-8a7d-24f933dcd3fa tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-50faac7f-9b03-4e01-918d-00bf6e0e6810" acquired by "delete_volume" :: waited 0.024s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:19 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c281d23-a9ff-48cd-8d61-7cd5d0b24b5e]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5f2f60f6-26e4-467d-8a7d-24f933dcd3fa tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:19 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810 Sep 04 15:56:19 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:20 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5f2f60f6-26e4-467d-8a7d-24f933dcd3fa tempest-GroupSnapshotsTest-720540587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810" returned: 0 in 0.460s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5f2f60f6-26e4-467d-8a7d-24f933dcd3fa tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:20 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810 Sep 04 15:56:20 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ff428444-85f8-4156-a1e0-f8012ffba5b4 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ff428444-85f8-4156-a1e0-f8012ffba5b4 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:20 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ff428444-85f8-4156-a1e0-f8012ffba5b4 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:56:20 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:20 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ff428444-85f8-4156-a1e0-f8012ffba5b4 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:56:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ff428444-85f8-4156-a1e0-f8012ffba5b4 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ff428444-85f8-4156-a1e0-f8012ffba5b4 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5f2f60f6-26e4-467d-8a7d-24f933dcd3fa tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-50faac7f-9b03-4e01-918d-00bf6e0e6810" returned: 0 in 0.342s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:20 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:56:20 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:20 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5f2f60f6-26e4-467d-8a7d-24f933dcd3fa tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-50faac7f-9b03-4e01-918d-00bf6e0e6810" released by "delete_volume" :: held 0.885s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:20 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5f2f60f6-26e4-467d-8a7d-24f933dcd3fa tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "cinder-quobyte-fd2d504a-2e39-48d7-89bf-eceabafa8ca0" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:20 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5f2f60f6-26e4-467d-8a7d-24f933dcd3fa tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-fd2d504a-2e39-48d7-89bf-eceabafa8ca0" acquired by "delete_volume" :: waited 0.015s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:20 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45f78fe-09ce-448b-a72f-ddd6c9669c09]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5f2f60f6-26e4-467d-8a7d-24f933dcd3fa tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:20 devstack sudo[97328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0 Sep 04 15:56:20 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:21 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ff428444-85f8-4156-a1e0-f8012ffba5b4 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.416s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:21 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-ff428444-85f8-4156-a1e0-f8012ffba5b4 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:56:21 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-ff428444-85f8-4156-a1e0-f8012ffba5b4 tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Retype volume completed successfully. Sep 04 15:56:21 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5f2f60f6-26e4-467d-8a7d-24f933dcd3fa tempest-GroupSnapshotsTest-720540587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0" returned: 0 in 0.439s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5f2f60f6-26e4-467d-8a7d-24f933dcd3fa tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:21 devstack sudo[97336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0 Sep 04 15:56:21 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:21 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5f2f60f6-26e4-467d-8a7d-24f933dcd3fa tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd2d504a-2e39-48d7-89bf-eceabafa8ca0" returned: 0 in 0.245s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5f2f60f6-26e4-467d-8a7d-24f933dcd3fa tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-fd2d504a-2e39-48d7-89bf-eceabafa8ca0" released by "delete_volume" :: held 0.785s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:21 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-5f2f60f6-26e4-467d-8a7d-24f933dcd3fa tempest-GroupSnapshotsTest-720540587 None] Created reservations ['fd25fd92-5bea-43fe-9ca1-1985c10300f2'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:56:21 devstack cinder-volume[87490]: WARNING cinder.quota [None req-5f2f60f6-26e4-467d-8a7d-24f933dcd3fa tempest-GroupSnapshotsTest-720540587 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1339942785 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1339942785, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:56:21 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-5f2f60f6-26e4-467d-8a7d-24f933dcd3fa tempest-GroupSnapshotsTest-720540587 None] Created reservations ['11951ace-a6c2-4a2b-8ae3-1967236509d4', 'a76907a6-4dbc-4ab0-8095-36ab2aba2ebb', 'e7257185-b1fe-426a-b24d-d6696dc9dbc7', 'e1275d91-c549-4ddf-9abc-4f6fb0b00b49'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:56:21 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-5f2f60f6-26e4-467d-8a7d-24f933dcd3fa tempest-GroupSnapshotsTest-720540587 None] Created reservations ['0fe872ec-ff78-43a9-be9b-6f0b6a9e8842', '53adf77b-ce75-48ea-990b-74a06c72e8c5', 'a4f28fdc-36ed-4e72-afea-50bbcebf52b6', 'baee506b-6076-4f8c-9eb7-7d35bb2f2ceb'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:56:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-733f5cd7-34f7-4437-a097-088f8ebad14c tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Acquiring lock "cinder-93b8ebdc-587f-46c8-ae74-d3c164814862-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-733f5cd7-34f7-4437-a097-088f8ebad14c tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Lock "cinder-93b8ebdc-587f-46c8-ae74-d3c164814862-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-733f5cd7-34f7-4437-a097-088f8ebad14c tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Acquiring lock "cinder-quobyte-93b8ebdc-587f-46c8-ae74-d3c164814862" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-733f5cd7-34f7-4437-a097-088f8ebad14c tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Lock "cinder-quobyte-93b8ebdc-587f-46c8-ae74-d3c164814862" acquired by "delete_volume" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5f2f60f6-26e4-467d-8a7d-24f933dcd3fa tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5f2f60f6-26e4-467d-8a7d-24f933dcd3fa tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-5f2f60f6-26e4-467d-8a7d-24f933dcd3fa tempest-GroupSnapshotsTest-720540587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:56:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-5f2f60f6-26e4-467d-8a7d-24f933dcd3fa tempest-GroupSnapshotsTest-720540587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:56:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5f2f60f6-26e4-467d-8a7d-24f933dcd3fa tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5f2f60f6-26e4-467d-8a7d-24f933dcd3fa tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:22 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[194a580b-a4ea-4b22-a6e6-02c04ced19e2]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-733f5cd7-34f7-4437-a097-088f8ebad14c tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-93b8ebdc-587f-46c8-ae74-d3c164814862 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:22 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:56:22 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:22 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-93b8ebdc-587f-46c8-ae74-d3c164814862 Sep 04 15:56:22 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:22 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5f2f60f6-26e4-467d-8a7d-24f933dcd3fa tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.594s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:22 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-5f2f60f6-26e4-467d-8a7d-24f933dcd3fa tempest-GroupSnapshotsTest-720540587 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:56:22 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-5f2f60f6-26e4-467d-8a7d-24f933dcd3fa tempest-GroupSnapshotsTest-720540587 None] Delete group completed successfully. Sep 04 15:56:22 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-733f5cd7-34f7-4437-a097-088f8ebad14c tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-93b8ebdc-587f-46c8-ae74-d3c164814862" returned: 0 in 0.739s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-733f5cd7-34f7-4437-a097-088f8ebad14c tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-93b8ebdc-587f-46c8-ae74-d3c164814862 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:22 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-93b8ebdc-587f-46c8-ae74-d3c164814862 Sep 04 15:56:22 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:23 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-befce418-35c2-42e7-a49f-f96735cf06e4 tempest-GroupSnapshotsTest-720540587 None] Group tempest-GroupSnapshotsTest-Group-975916647: creating Sep 04 15:56:23 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-befce418-35c2-42e7-a49f-f96735cf06e4 tempest-GroupSnapshotsTest-720540587 None] Group tempest-GroupSnapshotsTest-Group-975916647: created successfully Sep 04 15:56:23 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-befce418-35c2-42e7-a49f-f96735cf06e4 tempest-GroupSnapshotsTest-720540587 None] Create group completed successfully. Sep 04 15:56:23 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-733f5cd7-34f7-4437-a097-088f8ebad14c tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-93b8ebdc-587f-46c8-ae74-d3c164814862" returned: 0 in 0.379s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-733f5cd7-34f7-4437-a097-088f8ebad14c tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Lock "cinder-quobyte-93b8ebdc-587f-46c8-ae74-d3c164814862" released by "delete_volume" :: held 1.205s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:23 devstack cinder-volume[87490]: WARNING cinder.quota [None req-733f5cd7-34f7-4437-a097-088f8ebad14c tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:56:23 devstack cinder-volume[87490]: WARNING cinder.quota [None req-733f5cd7-34f7-4437-a097-088f8ebad14c tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:56:23 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-733f5cd7-34f7-4437-a097-088f8ebad14c tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Created reservations ['3fac176c-93c7-436d-9fd9-0ac67eaa9c5e', '393091d8-a70e-4ed6-be6d-dd23efe68457', '5e320089-52f7-40ee-aa85-d38524ac24ce', 'a5f229e7-2fe5-42d8-83fd-77e500c3b1dc'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:56:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-733f5cd7-34f7-4437-a097-088f8ebad14c tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-733f5cd7-34f7-4437-a097-088f8ebad14c tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:23 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-733f5cd7-34f7-4437-a097-088f8ebad14c tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:56:23 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-733f5cd7-34f7-4437-a097-088f8ebad14c tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:56:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-733f5cd7-34f7-4437-a097-088f8ebad14c tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-733f5cd7-34f7-4437-a097-088f8ebad14c tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:23 devstack sudo[97351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:56:23 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:23 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-733f5cd7-34f7-4437-a097-088f8ebad14c tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.363s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:23 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-733f5cd7-34f7-4437-a097-088f8ebad14c tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:56:23 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-733f5cd7-34f7-4437-a097-088f8ebad14c tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Deleted volume successfully. Sep 04 15:56:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-733f5cd7-34f7-4437-a097-088f8ebad14c tempest-VolumeRetypeWithoutMigrationTest-1113998868 None] Lock "cinder-93b8ebdc-587f-46c8-ae74-d3c164814862-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:24 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:56:24 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Flow 'volume_create_manager' (8ef1f5c4-ea93-491c-afe7-f6540ead529c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:56:24 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b5f08d9-5b0d-4ceb-a6f5-8077e06c4674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b5f08d9-5b0d-4ceb-a6f5-8077e06c4674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1655853126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f9b7bab5-54b0-46e1-a73f-534b5e26d6ea,host='devstack@QuobyteHD#QuobyteHD',id=3475ed5c-a34e-4b1a-8188-8d47f3243fa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf6533eb8f14487aa6ff16635e4f8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:25Z,use_quota=True,user_id='5f124db038e44042953cac40ebd39681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3734ae48-0aad-4a01-a198-2ff95874028a),volume_type_id=3734ae48-0aad-4a01-a198-2ff95874028a)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ef7a7d-6b4f-4443-885a-3c8313b744c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ef7a7d-6b4f-4443-885a-3c8313b744c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ccedfc2-2859-44f5-864b-314be43d2a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ccedfc2-2859-44f5-864b-314be43d2a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3475ed5c-a34e-4b1a-8188-8d47f3243fa6', 'volume_name': 'volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8272314-eb0a-4623-8b21-2b60dc918abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8272314-eb0a-4623-8b21-2b60dc918abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1afe7e9b-94fa-441c-a02f-ed33aee1da20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:25 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Volume 3475ed5c-a34e-4b1a-8188-8d47f3243fa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6', 'volume_size': 1} Sep 04 15:56:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f9b7bab5-54b0-46e1-a73f-534b5e26d6ea,created_at=2026-09-04T13:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1655853126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f9b7bab5-54b0-46e1-a73f-534b5e26d6ea,host='devstack@QuobyteHD#QuobyteHD',id=3475ed5c-a34e-4b1a-8188-8d47f3243fa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf6533eb8f14487aa6ff16635e4f8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:25Z,use_quota=True,user_id='5f124db038e44042953cac40ebd39681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3734ae48-0aad-4a01-a198-2ff95874028a),volume_type_id=3734ae48-0aad-4a01-a198-2ff95874028a)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:56:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Creating volume 3475ed5c-a34e-4b1a-8188-8d47f3243fa6 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:56:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:56:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:56:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:56:25 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:56:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:25 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6 1073741824 Sep 04 15:56:25 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:25 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6 1073741824" returned: 0 in 0.792s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:25 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6 Sep 04 15:56:25 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:26 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6" returned: 0 in 0.387s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:26 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:56:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1afe7e9b-94fa-441c-a02f-ed33aee1da20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1948f304-8ad4-4752-a859-c40a8471f7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:26 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Volume volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6 (3475ed5c-a34e-4b1a-8188-8d47f3243fa6): created successfully Sep 04 15:56:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1948f304-8ad4-4752-a859-c40a8471f7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Flow 'volume_create_manager' (8ef1f5c4-ea93-491c-afe7-f6540ead529c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:56:26 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-beb53a2a-a59b-444d-a174-e846de4ba3d2 tempest-GroupSnapshotsTest-720540587 None] Created volume successfully. Sep 04 15:56:27 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-a303fd8e-d77a-48e2-9bd4-81b23d221253 tempest-GroupSnapshotsTest-720540587 None] GroupSnapshot ee72e809-35e4-4c80-b1d1-735d570c1129: creating. Sep 04 15:56:28 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a303fd8e-d77a-48e2-9bd4-81b23d221253 tempest-GroupSnapshotsTest-720540587 None] Group snapshot ee72e809-35e4-4c80-b1d1-735d570c1129: creating. {{(pid=87490) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 04 15:56:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a303fd8e-d77a-48e2-9bd4-81b23d221253 tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a303fd8e-d77a-48e2-9bd4-81b23d221253 tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:28 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-a303fd8e-d77a-48e2-9bd4-81b23d221253 tempest-GroupSnapshotsTest-720540587 None] Creating offline snapshot 417d01a2-eacc-48b5-ab97-f2df5956c8df of volume 3475ed5c-a34e-4b1a-8188-8d47f3243fa6 {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:56:28 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[554cd982-7f2c-4038-8cc2-1ed7d2e5d611]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a303fd8e-d77a-48e2-9bd4-81b23d221253 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:28 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6 Sep 04 15:56:28 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:28 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a303fd8e-d77a-48e2-9bd4-81b23d221253 tempest-GroupSnapshotsTest-720540587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6" returned: 0 in 0.564s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a303fd8e-d77a-48e2-9bd4-81b23d221253 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6.417d01a2-eacc-48b5-ab97-f2df5956c8df 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:28 devstack sudo[97510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6.417d01a2-eacc-48b5-ab97-f2df5956c8df 1G Sep 04 15:56:28 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:29 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a303fd8e-d77a-48e2-9bd4-81b23d221253 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6.417d01a2-eacc-48b5-ab97-f2df5956c8df 1G" returned: 0 in 0.673s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a303fd8e-d77a-48e2-9bd4-81b23d221253 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6.417d01a2-eacc-48b5-ab97-f2df5956c8df {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:29 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6.417d01a2-eacc-48b5-ab97-f2df5956c8df Sep 04 15:56:29 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:29 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a303fd8e-d77a-48e2-9bd4-81b23d221253 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6.417d01a2-eacc-48b5-ab97-f2df5956c8df" returned: 0 in 0.378s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:29 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-a303fd8e-d77a-48e2-9bd4-81b23d221253 tempest-GroupSnapshotsTest-720540587 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6.417d01a2-eacc-48b5-ab97-f2df5956c8df is being set with open permissions: ugo+rw: NotImplementedError Sep 04 15:56:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a303fd8e-d77a-48e2-9bd4-81b23d221253 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6.417d01a2-eacc-48b5-ab97-f2df5956c8df {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:29 devstack sudo[97521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6.417d01a2-eacc-48b5-ab97-f2df5956c8df Sep 04 15:56:29 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:30 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a303fd8e-d77a-48e2-9bd4-81b23d221253 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6.417d01a2-eacc-48b5-ab97-f2df5956c8df" returned: 0 in 0.323s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:30 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:UPDATE=184,cinder:DELETE=5,cinder:SELECT=181,cinder:INSERT=40 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:56:30 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=176,cinder:INSERT=51,cinder:UPDATE=198,cinder:DELETE=8 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:56:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a303fd8e-d77a-48e2-9bd4-81b23d221253 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:30 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6.info Sep 04 15:56:30 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:30 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a303fd8e-d77a-48e2-9bd4-81b23d221253 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6.info" returned: 0 in 0.560s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:30 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-a303fd8e-d77a-48e2-9bd4-81b23d221253 tempest-GroupSnapshotsTest-720540587 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 15:56:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a303fd8e-d77a-48e2-9bd4-81b23d221253 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:30 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6.info Sep 04 15:56:30 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:31 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a303fd8e-d77a-48e2-9bd4-81b23d221253 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6.info" returned: 0 in 0.444s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a303fd8e-d77a-48e2-9bd4-81b23d221253 tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.081s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:31 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-a303fd8e-d77a-48e2-9bd4-81b23d221253 tempest-GroupSnapshotsTest-720540587 None] group_snapshot ee72e809-35e4-4c80-b1d1-735d570c1129: created successfully Sep 04 15:56:31 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-1129d7b2-24c5-448c-b2a9-1c5677ea0b7a tempest-GroupSnapshotsTest-720540587 None] group_snapshot ee72e809-35e4-4c80-b1d1-735d570c1129: deleting Sep 04 15:56:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1129d7b2-24c5-448c-b2a9-1c5677ea0b7a tempest-GroupSnapshotsTest-720540587 None] group_snapshot ee72e809-35e4-4c80-b1d1-735d570c1129: deleting {{(pid=87490) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 04 15:56:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1129d7b2-24c5-448c-b2a9-1c5677ea0b7a tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "cinder-quobyte-3475ed5c-a34e-4b1a-8188-8d47f3243fa6" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1129d7b2-24c5-448c-b2a9-1c5677ea0b7a tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-3475ed5c-a34e-4b1a-8188-8d47f3243fa6" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1129d7b2-24c5-448c-b2a9-1c5677ea0b7a tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "cinder-quobyte-417d01a2-eacc-48b5-ab97-f2df5956c8df" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1129d7b2-24c5-448c-b2a9-1c5677ea0b7a tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-417d01a2-eacc-48b5-ab97-f2df5956c8df" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:31 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-1129d7b2-24c5-448c-b2a9-1c5677ea0b7a tempest-GroupSnapshotsTest-720540587 None] Deleting offline snapshot 417d01a2-eacc-48b5-ab97-f2df5956c8df of volume 3475ed5c-a34e-4b1a-8188-8d47f3243fa6 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:56:31 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-1129d7b2-24c5-448c-b2a9-1c5677ea0b7a tempest-GroupSnapshotsTest-720540587 None] snapshot_file for this snap is: volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6.417d01a2-eacc-48b5-ab97-f2df5956c8df {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:56:31 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fcf5e6-fc50-4463-a2a9-e2fa02dd2cc4]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1129d7b2-24c5-448c-b2a9-1c5677ea0b7a tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6.417d01a2-eacc-48b5-ab97-f2df5956c8df {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:32 devstack sudo[97530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6.417d01a2-eacc-48b5-ab97-f2df5956c8df Sep 04 15:56:32 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:32 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:56:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Flow 'volume_create_manager' (7871c5a4-fd68-40ae-b797-a4a44a228cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:56:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec41d011-163a-43a9-b520-009ba1c92245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec41d011-163a-43a9-b520-009ba1c92245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1421730561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe14c9d1-5480-4702-a594-d29bd7a71618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e24fab3b0b014c1a9db33df4070847d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:32Z,use_quota=True,user_id='438f5fbe60bc42a9acfb1187ea0394e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b12399-487e-4653-ada1-acafd987e54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b12399-487e-4653-ada1-acafd987e54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6d99483-3ea5-48f6-a30a-b0892135f2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6d99483-3ea5-48f6-a30a-b0892135f2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe14c9d1-5480-4702-a594-d29bd7a71618', 'volume_name': 'volume-fe14c9d1-5480-4702-a594-d29bd7a71618', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6fe28f-52e0-4d90-a810-860e66ae74d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6fe28f-52e0-4d90-a810-860e66ae74d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (272e9b0b-c358-418a-a32b-cb7895ec6540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:32 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Volume fe14c9d1-5480-4702-a594-d29bd7a71618: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe14c9d1-5480-4702-a594-d29bd7a71618', 'volume_size': 1} Sep 04 15:56:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1421730561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe14c9d1-5480-4702-a594-d29bd7a71618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e24fab3b0b014c1a9db33df4070847d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:32Z,use_quota=True,user_id='438f5fbe60bc42a9acfb1187ea0394e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:56:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Creating volume fe14c9d1-5480-4702-a594-d29bd7a71618 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:56:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:56:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:56:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:56:32 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:56:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fe14c9d1-5480-4702-a594-d29bd7a71618 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:32 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1129d7b2-24c5-448c-b2a9-1c5677ea0b7a tempest-GroupSnapshotsTest-720540587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6.417d01a2-eacc-48b5-ab97-f2df5956c8df" returned: 0 in 0.834s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-1129d7b2-24c5-448c-b2a9-1c5677ea0b7a tempest-GroupSnapshotsTest-720540587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:56:32 devstack sudo[97535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fe14c9d1-5480-4702-a594-d29bd7a71618 1073741824 Sep 04 15:56:32 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:32 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a770ac3-eccc-430f-943d-b1e473b8763d]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1129d7b2-24c5-448c-b2a9-1c5677ea0b7a tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:32 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6 Sep 04 15:56:32 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:33 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1129d7b2-24c5-448c-b2a9-1c5677ea0b7a tempest-GroupSnapshotsTest-720540587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6" returned: 0 in 0.514s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1129d7b2-24c5-448c-b2a9-1c5677ea0b7a tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6.417d01a2-eacc-48b5-ab97-f2df5956c8df {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:33 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6.417d01a2-eacc-48b5-ab97-f2df5956c8df Sep 04 15:56:33 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:33 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fe14c9d1-5480-4702-a594-d29bd7a71618 1073741824" returned: 0 in 0.721s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fe14c9d1-5480-4702-a594-d29bd7a71618 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:33 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fe14c9d1-5480-4702-a594-d29bd7a71618 Sep 04 15:56:33 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:33 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1129d7b2-24c5-448c-b2a9-1c5677ea0b7a tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6.417d01a2-eacc-48b5-ab97-f2df5956c8df" returned: 0 in 0.531s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1129d7b2-24c5-448c-b2a9-1c5677ea0b7a tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6.417d01a2-eacc-48b5-ab97-f2df5956c8df {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:33 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6.417d01a2-eacc-48b5-ab97-f2df5956c8df Sep 04 15:56:33 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:33 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fe14c9d1-5480-4702-a594-d29bd7a71618" returned: 0 in 0.438s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:33 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:56:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:33 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (272e9b0b-c358-418a-a32b-cb7895ec6540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe14c9d1-5480-4702-a594-d29bd7a71618', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:33 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486e6073-2ae0-4699-87b8-13f2ec09de72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:33 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Volume volume-fe14c9d1-5480-4702-a594-d29bd7a71618 (fe14c9d1-5480-4702-a594-d29bd7a71618): created successfully Sep 04 15:56:33 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486e6073-2ae0-4699-87b8-13f2ec09de72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:33 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Flow 'volume_create_manager' (7871c5a4-fd68-40ae-b797-a4a44a228cb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:56:34 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-8d5fdfba-eac7-4a44-8e3a-e65a1709ff78 tempest-TestMinimumBasicScenario-1371772703 None] Created volume successfully. Sep 04 15:56:34 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1129d7b2-24c5-448c-b2a9-1c5677ea0b7a tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6.417d01a2-eacc-48b5-ab97-f2df5956c8df" returned: 0 in 0.472s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:34 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1129d7b2-24c5-448c-b2a9-1c5677ea0b7a tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-417d01a2-eacc-48b5-ab97-f2df5956c8df" released by "_delete_snapshot" :: held 2.526s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:34 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1129d7b2-24c5-448c-b2a9-1c5677ea0b7a tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-3475ed5c-a34e-4b1a-8188-8d47f3243fa6" released by "delete_snapshot" :: held 2.579s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:34 devstack cinder-volume[87490]: WARNING cinder.quota [None req-1129d7b2-24c5-448c-b2a9-1c5677ea0b7a tempest-GroupSnapshotsTest-720540587 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1171504182 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1171504182, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:56:34 devstack cinder-volume[87490]: WARNING cinder.quota [None req-1129d7b2-24c5-448c-b2a9-1c5677ea0b7a tempest-GroupSnapshotsTest-720540587 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1171504182 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1171504182, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:56:34 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-1129d7b2-24c5-448c-b2a9-1c5677ea0b7a tempest-GroupSnapshotsTest-720540587 None] Created reservations ['b122b9e9-5dfa-4f04-84b0-f22bf6235a9c', 'e0d792b2-7f30-41a5-9a00-4595168826b9', '84bb7d51-07de-4579-9bef-9ecda806031a', 'f05ea6b6-f4d8-44a0-a2e9-55eadb7c3fa6'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:56:34 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-1129d7b2-24c5-448c-b2a9-1c5677ea0b7a tempest-GroupSnapshotsTest-720540587 None] group_snapshot ee72e809-35e4-4c80-b1d1-735d570c1129: deleted successfully Sep 04 15:56:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-106ec068-4c7d-4889-a73f-a30a0730db51 tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "cinder-quobyte-3475ed5c-a34e-4b1a-8188-8d47f3243fa6" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-106ec068-4c7d-4889-a73f-a30a0730db51 tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-3475ed5c-a34e-4b1a-8188-8d47f3243fa6" acquired by "delete_volume" :: waited 0.063s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:35 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6df6170-340b-4445-b878-da15be40cfc3]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-106ec068-4c7d-4889-a73f-a30a0730db51 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:36 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6 Sep 04 15:56:36 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-b6507ee4-7505-4e2a-b14a-edc0d3d6b9ae req-28a246e3-41c7-4967-aca8-e76e84d2f061 tempest-TestMinimumBasicScenario-1371772703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-b6507ee4-7505-4e2a-b14a-edc0d3d6b9ae req-28a246e3-41c7-4967-aca8-e76e84d2f061 tempest-TestMinimumBasicScenario-1371772703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-b6507ee4-7505-4e2a-b14a-edc0d3d6b9ae req-28a246e3-41c7-4967-aca8-e76e84d2f061 tempest-TestMinimumBasicScenario-1371772703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:36 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-b6507ee4-7505-4e2a-b14a-edc0d3d6b9ae req-28a246e3-41c7-4967-aca8-e76e84d2f061 tempest-TestMinimumBasicScenario-1371772703 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787', 'name': 'volume-fe14c9d1-5480-4702-a594-d29bd7a71618', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'abe4e7ff-e308-47b2-b8db-e2e73c79d3ed', 'enforce_multipath': True} {{(pid=87490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 15:56:36 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-b6507ee4-7505-4e2a-b14a-edc0d3d6b9ae req-28a246e3-41c7-4967-aca8-e76e84d2f061 tempest-TestMinimumBasicScenario-1371772703 None] attachment_update completed successfully. Sep 04 15:56:36 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-106ec068-4c7d-4889-a73f-a30a0730db51 tempest-GroupSnapshotsTest-720540587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6" returned: 0 in 0.721s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-106ec068-4c7d-4889-a73f-a30a0730db51 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:36 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6 Sep 04 15:56:36 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:37 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-106ec068-4c7d-4889-a73f-a30a0730db51 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3475ed5c-a34e-4b1a-8188-8d47f3243fa6" returned: 0 in 0.530s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:37 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-106ec068-4c7d-4889-a73f-a30a0730db51 tempest-GroupSnapshotsTest-720540587 None] Lock "cinder-quobyte-3475ed5c-a34e-4b1a-8188-8d47f3243fa6" released by "delete_volume" :: held 1.381s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:37 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-106ec068-4c7d-4889-a73f-a30a0730db51 tempest-GroupSnapshotsTest-720540587 None] Created reservations ['20517a03-c798-45dd-91c7-479a164c1e86'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:56:37 devstack cinder-volume[87490]: WARNING cinder.quota [None req-106ec068-4c7d-4889-a73f-a30a0730db51 tempest-GroupSnapshotsTest-720540587 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1171504182 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1171504182, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:56:37 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-106ec068-4c7d-4889-a73f-a30a0730db51 tempest-GroupSnapshotsTest-720540587 None] Created reservations ['7b532715-13bc-4e3c-aa91-00146edccfe3', '5143e620-533b-4867-afc6-d71f3efdb0f5', '128a62cd-771b-4776-b7b0-dd2bb50f4255', 'b66b5e69-495e-4849-80aa-7f716e5f6526'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:56:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-106ec068-4c7d-4889-a73f-a30a0730db51 tempest-GroupSnapshotsTest-720540587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-106ec068-4c7d-4889-a73f-a30a0730db51 tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:37 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-106ec068-4c7d-4889-a73f-a30a0730db51 tempest-GroupSnapshotsTest-720540587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:56:37 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-106ec068-4c7d-4889-a73f-a30a0730db51 tempest-GroupSnapshotsTest-720540587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:56:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-106ec068-4c7d-4889-a73f-a30a0730db51 tempest-GroupSnapshotsTest-720540587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-106ec068-4c7d-4889-a73f-a30a0730db51 tempest-GroupSnapshotsTest-720540587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:37 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:56:37 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:38 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-106ec068-4c7d-4889-a73f-a30a0730db51 tempest-GroupSnapshotsTest-720540587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.404s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:38 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-106ec068-4c7d-4889-a73f-a30a0730db51 tempest-GroupSnapshotsTest-720540587 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:56:38 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-106ec068-4c7d-4889-a73f-a30a0730db51 tempest-GroupSnapshotsTest-720540587 None] Delete group completed successfully. Sep 04 15:56:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:56:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:56:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:56:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:38 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:56:38 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:38 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.396s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:38 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:56:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager._thread_info {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:56:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread count: 28 {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:56:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread info: [<_MainThread(MainThread, started 138899118923904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:56:43 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:56:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Flow 'volume_create_manager' (b7c0e45d-c4c5-47f4-a7e5-39c14ce5666e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:56:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (969d28d8-6f77-493e-ab98-d00653dff1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (969d28d8-6f77-493e-ab98-d00653dff1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1121005039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c59390b252c4b2bade52b354860557f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:43Z,use_quota=True,user_id='bddb9113e7104c7c8e3b05f9c5598471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36833063-462b-4944-ab49-9db11ddd9fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36833063-462b-4944-ab49-9db11ddd9fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (718a9be3-d627-4ff6-945b-46ce41112c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:43 devstack cinder-volume[87490]: DEBUG cinder.image.glance [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Creating Keystone auth plugin from conf {{(pid=87490) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Flow 'volume_create_manager' (816d8d22-fd2e-463a-a3bc-c2dd138a5a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f49340-fd47-43ff-ab05-f2586bfcef09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f49340-fd47-43ff-ab05-f2586bfcef09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-994517991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f793f88f-0899-4373-806a-2a6691883eab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862e7aec817947e1905dde9c327a6ec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:44Z,use_quota=True,user_id='38154c811b5c432694e41cfddcf7302a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0ebc2a-924e-4073-9ca5-e49e988e6c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0ebc2a-924e-4073-9ca5-e49e988e6c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ecab43f-46bd-46ec-acb8-46d430aae664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ecab43f-46bd-46ec-acb8-46d430aae664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f793f88f-0899-4373-806a-2a6691883eab', 'volume_name': 'volume-f793f88f-0899-4373-806a-2a6691883eab', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07fbc81f-72b3-488c-b59f-b56b442cdbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07fbc81f-72b3-488c-b59f-b56b442cdbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f133a0a8-5794-4e17-9c9b-2a16fdbf0264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:44 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Volume f793f88f-0899-4373-806a-2a6691883eab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f793f88f-0899-4373-806a-2a6691883eab', 'volume_size': 1} Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-994517991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f793f88f-0899-4373-806a-2a6691883eab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='862e7aec817947e1905dde9c327a6ec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:44Z,use_quota=True,user_id='38154c811b5c432694e41cfddcf7302a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Creating volume f793f88f-0899-4373-806a-2a6691883eab {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:56:44 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f793f88f-0899-4373-806a-2a6691883eab 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:44 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f793f88f-0899-4373-806a-2a6691883eab 1073741824 Sep 04 15:56:44 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (718a9be3-d627-4ff6-945b-46ce41112c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96', 'volume_name': 'volume-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96', 'volume_size': 1, 'image_id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f11b89ae18364ea089a6f8a208910da3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'created_at': datetime.datetime(2026, 9, 4, 13, 42, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 42, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5558c17-c499-44af-95fb-afb0cb03a012/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e23442-d768-4379-b3a7-6e1df72693e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e23442-d768-4379-b3a7-6e1df72693e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1df8458-25ac-4b4d-9873-f384c6884984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:44 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Volume 4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96', 'volume_size': 1, 'image_id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f11b89ae18364ea089a6f8a208910da3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'created_at': datetime.datetime(2026, 9, 4, 13, 42, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 42, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5558c17-c499-44af-95fb-afb0cb03a012/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Trying to clone 4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96 from image b5558c17-c499-44af-95fb-afb0cb03a012 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}]). {{(pid=87490) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 15:56:44 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f793f88f-0899-4373-806a-2a6691883eab 1073741824" returned: 0 in 0.621s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_xf0a8a62devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 15:56:44 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Image download 20.69 MB at 20.69 MB/s Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f793f88f-0899-4373-806a-2a6691883eab {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:44 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f793f88f-0899-4373-806a-2a6691883eab Sep 04 15:56:44 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e2982f-f15b-455c-9df6-3fa70989e50f]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_xf0a8a62devstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:45 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_xf0a8a62devstack@QuobyteHD Sep 04 15:56:45 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:45 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f793f88f-0899-4373-806a-2a6691883eab" returned: 0 in 0.310s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:56:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f133a0a8-5794-4e17-9c9b-2a16fdbf0264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f793f88f-0899-4373-806a-2a6691883eab', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d1792f-8f93-4124-a22b-10da001d5101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:45 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Volume volume-f793f88f-0899-4373-806a-2a6691883eab (f793f88f-0899-4373-806a-2a6691883eab): created successfully Sep 04 15:56:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d1792f-8f93-4124-a22b-10da001d5101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Flow 'volume_create_manager' (816d8d22-fd2e-463a-a3bc-c2dd138a5a3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:56:45 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-13c793ac-d4da-489b-a171-8a122595021c tempest-VolumesServicesTestJSON-1812057307 None] Created volume successfully. Sep 04 15:56:45 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_xf0a8a62devstack@QuobyteHD" returned: 0 in 0.413s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:45 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Temporary image b5558c17-c499-44af-95fb-afb0cb03a012 is fetched for user bddb9113e7104c7c8e3b05f9c5598471. {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 15:56:45 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7da3cb-59e2-4e1d-b932-8004673d2294]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_xf0a8a62devstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:45 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_xf0a8a62devstack@QuobyteHD Sep 04 15:56:45 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:45 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_xf0a8a62devstack@QuobyteHD" returned: 0 in 0.343s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1121005039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c59390b252c4b2bade52b354860557f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:43Z,use_quota=True,user_id='bddb9113e7104c7c8e3b05f9c5598471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:56:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Creating volume 4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:56:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:56:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:56:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:56:45 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:56:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:45 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96 1073741824 Sep 04 15:56:45 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:46 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96 1073741824" returned: 0 in 0.552s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:46 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1ef8d981-82ed-4bcf-944d-169af2e5ba08 tempest-VolumesServicesTestJSON-1812057307 None] Acquiring lock "cinder-f793f88f-0899-4373-806a-2a6691883eab-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:46 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1ef8d981-82ed-4bcf-944d-169af2e5ba08 tempest-VolumesServicesTestJSON-1812057307 None] Lock "cinder-f793f88f-0899-4373-806a-2a6691883eab-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:46 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96 Sep 04 15:56:46 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:46 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1ef8d981-82ed-4bcf-944d-169af2e5ba08 tempest-VolumesServicesTestJSON-1812057307 None] Acquiring lock "cinder-quobyte-f793f88f-0899-4373-806a-2a6691883eab" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:46 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-80608cc4-eb12-4ff4-8e54-ff1a1d7685a7 tempest-GroupsTest-29711870 None] Group tempest-Group1-1470479304: creating Sep 04 15:56:46 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1ef8d981-82ed-4bcf-944d-169af2e5ba08 tempest-VolumesServicesTestJSON-1812057307 None] Lock "cinder-quobyte-f793f88f-0899-4373-806a-2a6691883eab" acquired by "delete_volume" :: waited 0.028s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:46 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcabf57e-acba-4518-bf30-412740c0fa3d]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1ef8d981-82ed-4bcf-944d-169af2e5ba08 tempest-VolumesServicesTestJSON-1812057307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f793f88f-0899-4373-806a-2a6691883eab {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:46 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-80608cc4-eb12-4ff4-8e54-ff1a1d7685a7 tempest-GroupsTest-29711870 None] Group tempest-Group1-1470479304: created successfully Sep 04 15:56:46 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-80608cc4-eb12-4ff4-8e54-ff1a1d7685a7 tempest-GroupsTest-29711870 None] Create group completed successfully. Sep 04 15:56:46 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f793f88f-0899-4373-806a-2a6691883eab Sep 04 15:56:46 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:46 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96" returned: 0 in 0.319s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:46 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:56:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:46 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Attempting download of b5558c17-c499-44af-95fb-afb0cb03a012 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}])) to volume 4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96. {{(pid=87490) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 15:56:46 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6731a5-7e7c-421f-8eab-fb5ded004e5e]: (4, 'raw') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_r8yvcdfn {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:46 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_r8yvcdfn Sep 04 15:56:46 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:47 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1ef8d981-82ed-4bcf-944d-169af2e5ba08 tempest-VolumesServicesTestJSON-1812057307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f793f88f-0899-4373-806a-2a6691883eab" returned: 0 in 0.431s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1ef8d981-82ed-4bcf-944d-169af2e5ba08 tempest-VolumesServicesTestJSON-1812057307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f793f88f-0899-4373-806a-2a6691883eab {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:47 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f793f88f-0899-4373-806a-2a6691883eab Sep 04 15:56:47 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:47 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_r8yvcdfn" returned: 0 in 0.380s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_r8yvcdfn {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:47 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1ef8d981-82ed-4bcf-944d-169af2e5ba08 tempest-VolumesServicesTestJSON-1812057307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f793f88f-0899-4373-806a-2a6691883eab" returned: 0 in 0.299s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1ef8d981-82ed-4bcf-944d-169af2e5ba08 tempest-VolumesServicesTestJSON-1812057307 None] Lock "cinder-quobyte-f793f88f-0899-4373-806a-2a6691883eab" released by "delete_volume" :: held 0.802s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:47 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_r8yvcdfn Sep 04 15:56:47 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:47 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-1ef8d981-82ed-4bcf-944d-169af2e5ba08 tempest-VolumesServicesTestJSON-1812057307 None] Created reservations ['b8afe826-fe00-4566-98ab-adfe4ebf4941', 'df54c75d-038d-4b66-9739-b01bf025c750', '07344b1d-d2d6-4130-a08e-64666d1402b8', '67b5e582-5b82-465f-956a-4b5429552962'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:56:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1ef8d981-82ed-4bcf-944d-169af2e5ba08 tempest-VolumesServicesTestJSON-1812057307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1ef8d981-82ed-4bcf-944d-169af2e5ba08 tempest-VolumesServicesTestJSON-1812057307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:47 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1ef8d981-82ed-4bcf-944d-169af2e5ba08 tempest-VolumesServicesTestJSON-1812057307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:56:47 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1ef8d981-82ed-4bcf-944d-169af2e5ba08 tempest-VolumesServicesTestJSON-1812057307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:56:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1ef8d981-82ed-4bcf-944d-169af2e5ba08 tempest-VolumesServicesTestJSON-1812057307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1ef8d981-82ed-4bcf-944d-169af2e5ba08 tempest-VolumesServicesTestJSON-1812057307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:47 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:56:47 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:47 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_r8yvcdfn" returned: 1 in 0.433s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_r8yvcdfn' failed. Not Retrying. {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:56:47 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f2cac3-ee2c-4c0d-b6e1-eb113ddbe5ce]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_xf0a8a62devstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:47 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-70058cfc-b2ef-43ff-b5fc-9021dae0372b tempest-GroupsTest-29711870 None] Group tempest-Group2-1805263869: creating Sep 04 15:56:47 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-70058cfc-b2ef-43ff-b5fc-9021dae0372b tempest-GroupsTest-29711870 None] Group tempest-Group2-1805263869: created successfully Sep 04 15:56:47 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_xf0a8a62devstack@QuobyteHD Sep 04 15:56:47 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:47 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1ef8d981-82ed-4bcf-944d-169af2e5ba08 tempest-VolumesServicesTestJSON-1812057307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.323s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:47 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-1ef8d981-82ed-4bcf-944d-169af2e5ba08 tempest-VolumesServicesTestJSON-1812057307 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:56:47 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-1ef8d981-82ed-4bcf-944d-169af2e5ba08 tempest-VolumesServicesTestJSON-1812057307 None] Deleted volume successfully. Sep 04 15:56:47 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-70058cfc-b2ef-43ff-b5fc-9021dae0372b tempest-GroupsTest-29711870 None] Create group completed successfully. Sep 04 15:56:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1ef8d981-82ed-4bcf-944d-169af2e5ba08 tempest-VolumesServicesTestJSON-1812057307 None] Lock "cinder-f793f88f-0899-4373-806a-2a6691883eab-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:48 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_xf0a8a62devstack@QuobyteHD" returned: 0 in 0.404s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:48 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] b5558c17-c499-44af-95fb-afb0cb03a012 was qcow2, converting to qcow2 {{(pid=87490) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 15:56:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_xf0a8a62devstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:48 devstack sudo[98063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_xf0a8a62devstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96 Sep 04 15:56:48 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:49 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:56:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Flow 'volume_create_manager' (c4d5e3d4-354e-4cb3-b98b-69e1cba9201f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:56:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4f596f4-f528-4675-9d87-55a3d6ead274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4f596f4-f528-4675-9d87-55a3d6ead274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-302487918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8b035e08-78e8-4095-8087-154846a5d94b,host='devstack@QuobyteHD#QuobyteHD',id=d7751e72-ce88-4fa6-98c9-55c726aba82f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52433e1f8277445ab32197d15742d857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:50Z,use_quota=True,user_id='db8b90bf0dcc4f35a3a375a20c5ead4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dda6e773-86e8-4905-98ce-6bf4f4398d0e),volume_type_id=dda6e773-86e8-4905-98ce-6bf4f4398d0e)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c1a919-d99b-4e9b-a713-c1beb628348d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c1a919-d99b-4e9b-a713-c1beb628348d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8208ad4-b169-4fc7-9635-274161adfd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8208ad4-b169-4fc7-9635-274161adfd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7751e72-ce88-4fa6-98c9-55c726aba82f', 'volume_name': 'volume-d7751e72-ce88-4fa6-98c9-55c726aba82f', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece995d0-96e2-475f-a74d-fc061cd9add4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece995d0-96e2-475f-a74d-fc061cd9add4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef907426-7b72-46f8-a7c3-603fa3d389e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:49 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Volume d7751e72-ce88-4fa6-98c9-55c726aba82f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7751e72-ce88-4fa6-98c9-55c726aba82f', 'volume_size': 1} Sep 04 15:56:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8b035e08-78e8-4095-8087-154846a5d94b,created_at=2026-09-04T13:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-302487918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8b035e08-78e8-4095-8087-154846a5d94b,host='devstack@QuobyteHD#QuobyteHD',id=d7751e72-ce88-4fa6-98c9-55c726aba82f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52433e1f8277445ab32197d15742d857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:50Z,use_quota=True,user_id='db8b90bf0dcc4f35a3a375a20c5ead4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dda6e773-86e8-4905-98ce-6bf4f4398d0e),volume_type_id=dda6e773-86e8-4905-98ce-6bf4f4398d0e)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:56:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Creating volume d7751e72-ce88-4fa6-98c9-55c726aba82f {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:56:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:56:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:56:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:56:49 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:56:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d7751e72-ce88-4fa6-98c9-55c726aba82f 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:49 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d7751e72-ce88-4fa6-98c9-55c726aba82f 1073741824 Sep 04 15:56:49 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:50 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_xf0a8a62devstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96" returned: 0 in 2.089s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:50 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_xf0a8a62devstack@QuobyteHD, size 112.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96 {{(pid=87490) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 15:56:50 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Converted 112.00 MB image at 53.59 MB/s Sep 04 15:56:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:50 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96 1G Sep 04 15:56:50 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:50 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d7751e72-ce88-4fa6-98c9-55c726aba82f 1073741824" returned: 0 in 0.644s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d7751e72-ce88-4fa6-98c9-55c726aba82f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:50 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d7751e72-ce88-4fa6-98c9-55c726aba82f Sep 04 15:56:50 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:50 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96 1G" returned: 0 in 0.512s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:50 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Downloaded image b5558c17-c499-44af-95fb-afb0cb03a012 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}])) to volume 4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96 successfully. {{(pid=87490) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 15:56:50 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Temporary image b5558c17-c499-44af-95fb-afb0cb03a012 for user bddb9113e7104c7c8e3b05f9c5598471 is deleted. {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 15:56:50 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Marking volume 4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96 as bootable. {{(pid=87490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 15:56:50 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Copying metadata from image b5558c17-c499-44af-95fb-afb0cb03a012 to 4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96. {{(pid=87490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 15:56:50 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Creating volume glance metadata for volume 4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96 backed by image b5558c17-c499-44af-95fb-afb0cb03a012 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87490) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 15:56:50 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1df8458-25ac-4b4d-9873-f384c6884984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96', 'volume_size': 1, 'image_id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f11b89ae18364ea089a6f8a208910da3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'created_at': datetime.datetime(2026, 9, 4, 13, 42, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 42, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5558c17-c499-44af-95fb-afb0cb03a012/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542ab795-a604-4765-91d0-808bd20bc5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d7751e72-ce88-4fa6-98c9-55c726aba82f" returned: 0 in 0.421s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:56:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef907426-7b72-46f8-a7c3-603fa3d389e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7751e72-ce88-4fa6-98c9-55c726aba82f', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ba64ec-95d4-476d-b96d-7cba4dc8efb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:51 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Volume volume-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96 (4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96): created successfully Sep 04 15:56:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542ab795-a604-4765-91d0-808bd20bc5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Flow 'volume_create_manager' (b7c0e45d-c4c5-47f4-a7e5-39c14ce5666e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:56:51 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-4da4a351-4f4a-481b-a024-b1c787768fbb tempest-VolumesImageMetadata-606858429 None] Created volume successfully. Sep 04 15:56:51 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Volume volume-d7751e72-ce88-4fa6-98c9-55c726aba82f (d7751e72-ce88-4fa6-98c9-55c726aba82f): created successfully Sep 04 15:56:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ba64ec-95d4-476d-b96d-7cba4dc8efb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Flow 'volume_create_manager' (c4d5e3d4-354e-4cb3-b98b-69e1cba9201f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:56:51 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-e509286e-6e49-499f-a681-9b945ecf7be4 tempest-GroupsTest-29711870 None] Created volume successfully. Sep 04 15:56:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d6d629bf-c903-4bdf-934f-e25498b32ac3 tempest-VolumesImageMetadata-606858429 None] Acquiring lock "cinder-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d6d629bf-c903-4bdf-934f-e25498b32ac3 tempest-VolumesImageMetadata-606858429 None] Lock "cinder-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d6d629bf-c903-4bdf-934f-e25498b32ac3 tempest-VolumesImageMetadata-606858429 None] Acquiring lock "cinder-quobyte-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d6d629bf-c903-4bdf-934f-e25498b32ac3 tempest-VolumesImageMetadata-606858429 None] Lock "cinder-quobyte-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96" acquired by "delete_volume" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:52 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[33601638-fc9e-42e6-9720-c2543b6d045f]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d6d629bf-c903-4bdf-934f-e25498b32ac3 tempest-VolumesImageMetadata-606858429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:52 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96 Sep 04 15:56:52 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:52 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d6d629bf-c903-4bdf-934f-e25498b32ac3 tempest-VolumesImageMetadata-606858429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96" returned: 0 in 0.423s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d6d629bf-c903-4bdf-934f-e25498b32ac3 tempest-VolumesImageMetadata-606858429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:52 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96 Sep 04 15:56:52 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e16c9df3-1d56-4c1a-944c-a609d51d5a3a tempest-GroupsTest-29711870 None] Acquiring lock "cinder-quobyte-d7751e72-ce88-4fa6-98c9-55c726aba82f" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:56:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e16c9df3-1d56-4c1a-944c-a609d51d5a3a tempest-GroupsTest-29711870 None] Lock "cinder-quobyte-d7751e72-ce88-4fa6-98c9-55c726aba82f" acquired by "delete_volume" :: waited 0.016s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:56:52 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aaabd52-52f2-4dfa-a3e0-c676c857da06]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:56:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e16c9df3-1d56-4c1a-944c-a609d51d5a3a tempest-GroupsTest-29711870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d7751e72-ce88-4fa6-98c9-55c726aba82f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:53 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d7751e72-ce88-4fa6-98c9-55c726aba82f Sep 04 15:56:53 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:53 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d6d629bf-c903-4bdf-934f-e25498b32ac3 tempest-VolumesImageMetadata-606858429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96" returned: 0 in 0.299s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d6d629bf-c903-4bdf-934f-e25498b32ac3 tempest-VolumesImageMetadata-606858429 None] Lock "cinder-quobyte-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96" released by "delete_volume" :: held 0.768s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:53 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-d6d629bf-c903-4bdf-934f-e25498b32ac3 tempest-VolumesImageMetadata-606858429 None] Created reservations ['b2706145-1507-4581-8be7-cb87e6abcad2', 'd4605d00-2e9c-4c22-b14c-c7c1625fff23', '3e57de50-c406-4dba-8dfc-36230869ab2f', '2244ec10-c9ed-4a53-8999-06b7aac52f27'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:56:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d6d629bf-c903-4bdf-934f-e25498b32ac3 tempest-VolumesImageMetadata-606858429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d6d629bf-c903-4bdf-934f-e25498b32ac3 tempest-VolumesImageMetadata-606858429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d6d629bf-c903-4bdf-934f-e25498b32ac3 tempest-VolumesImageMetadata-606858429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:56:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d6d629bf-c903-4bdf-934f-e25498b32ac3 tempest-VolumesImageMetadata-606858429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:56:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d6d629bf-c903-4bdf-934f-e25498b32ac3 tempest-VolumesImageMetadata-606858429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d6d629bf-c903-4bdf-934f-e25498b32ac3 tempest-VolumesImageMetadata-606858429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:53 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:56:53 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:53 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e16c9df3-1d56-4c1a-944c-a609d51d5a3a tempest-GroupsTest-29711870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d7751e72-ce88-4fa6-98c9-55c726aba82f" returned: 0 in 0.395s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e16c9df3-1d56-4c1a-944c-a609d51d5a3a tempest-GroupsTest-29711870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d7751e72-ce88-4fa6-98c9-55c726aba82f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:53 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d7751e72-ce88-4fa6-98c9-55c726aba82f Sep 04 15:56:53 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:53 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d6d629bf-c903-4bdf-934f-e25498b32ac3 tempest-VolumesImageMetadata-606858429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.286s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:53 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d6d629bf-c903-4bdf-934f-e25498b32ac3 tempest-VolumesImageMetadata-606858429 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:56:53 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-d6d629bf-c903-4bdf-934f-e25498b32ac3 tempest-VolumesImageMetadata-606858429 None] Deleted volume successfully. Sep 04 15:56:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d6d629bf-c903-4bdf-934f-e25498b32ac3 tempest-VolumesImageMetadata-606858429 None] Lock "cinder-4f5e2e9f-8cca-4d08-9ea0-ba142cd26c96-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:53 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e16c9df3-1d56-4c1a-944c-a609d51d5a3a tempest-GroupsTest-29711870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d7751e72-ce88-4fa6-98c9-55c726aba82f" returned: 0 in 0.305s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e16c9df3-1d56-4c1a-944c-a609d51d5a3a tempest-GroupsTest-29711870 None] Lock "cinder-quobyte-d7751e72-ce88-4fa6-98c9-55c726aba82f" released by "delete_volume" :: held 0.744s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:56:53 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-e16c9df3-1d56-4c1a-944c-a609d51d5a3a tempest-GroupsTest-29711870 None] Created reservations ['6917d793-09d4-4079-a4df-381e56b12e3f'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:56:53 devstack cinder-volume[87490]: WARNING cinder.quota [None req-e16c9df3-1d56-4c1a-944c-a609d51d5a3a tempest-GroupsTest-29711870 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-329041538 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-329041538, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:56:53 devstack cinder-volume[87490]: WARNING cinder.quota [None req-e16c9df3-1d56-4c1a-944c-a609d51d5a3a tempest-GroupsTest-29711870 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-329041538 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-329041538, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:56:53 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-e16c9df3-1d56-4c1a-944c-a609d51d5a3a tempest-GroupsTest-29711870 None] Created reservations ['982c41ab-1223-40ea-8e01-24a3a1fa7d42', '1a303b61-6120-4931-b55f-a38ac55ff1fb', '9de48698-83bb-4aaa-b7d1-99320f95a1f4', 'fb76d532-dcb5-4194-9f38-dd1ec44c5b39'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:56:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e16c9df3-1d56-4c1a-944c-a609d51d5a3a tempest-GroupsTest-29711870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e16c9df3-1d56-4c1a-944c-a609d51d5a3a tempest-GroupsTest-29711870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e16c9df3-1d56-4c1a-944c-a609d51d5a3a tempest-GroupsTest-29711870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:56:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e16c9df3-1d56-4c1a-944c-a609d51d5a3a tempest-GroupsTest-29711870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:56:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e16c9df3-1d56-4c1a-944c-a609d51d5a3a tempest-GroupsTest-29711870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e16c9df3-1d56-4c1a-944c-a609d51d5a3a tempest-GroupsTest-29711870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:54 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:56:54 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:54 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e16c9df3-1d56-4c1a-944c-a609d51d5a3a tempest-GroupsTest-29711870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.267s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:54 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-e16c9df3-1d56-4c1a-944c-a609d51d5a3a tempest-GroupsTest-29711870 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:56:54 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-e16c9df3-1d56-4c1a-944c-a609d51d5a3a tempest-GroupsTest-29711870 None] Delete group completed successfully. Sep 04 15:56:54 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-3407e42f-4e29-4aa8-b647-f5b284957f43 tempest-GroupsTest-29711870 None] Created reservations ['596af65a-460d-4b85-8cd4-c3198a696608'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:56:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3407e42f-4e29-4aa8-b647-f5b284957f43 tempest-GroupsTest-29711870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3407e42f-4e29-4aa8-b647-f5b284957f43 tempest-GroupsTest-29711870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3407e42f-4e29-4aa8-b647-f5b284957f43 tempest-GroupsTest-29711870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:56:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3407e42f-4e29-4aa8-b647-f5b284957f43 tempest-GroupsTest-29711870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:56:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3407e42f-4e29-4aa8-b647-f5b284957f43 tempest-GroupsTest-29711870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3407e42f-4e29-4aa8-b647-f5b284957f43 tempest-GroupsTest-29711870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:54 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:56:54 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:54 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3407e42f-4e29-4aa8-b647-f5b284957f43 tempest-GroupsTest-29711870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.282s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:54 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-3407e42f-4e29-4aa8-b647-f5b284957f43 tempest-GroupsTest-29711870 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:56:54 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-3407e42f-4e29-4aa8-b647-f5b284957f43 tempest-GroupsTest-29711870 None] Delete group completed successfully. Sep 04 15:56:56 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-20815854-c632-4290-8822-b17fe182c05d tempest-GroupsTest-29711870 None] Group tempest-GroupsTest-Group-1731061347: creating Sep 04 15:56:56 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-20815854-c632-4290-8822-b17fe182c05d tempest-GroupsTest-29711870 None] Group tempest-GroupsTest-Group-1731061347: created successfully Sep 04 15:56:56 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-20815854-c632-4290-8822-b17fe182c05d tempest-GroupsTest-29711870 None] Create group completed successfully. Sep 04 15:56:58 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:56:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Flow 'volume_create_manager' (296c83c5-b170-4665-a484-3ff4cf77419a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:56:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a66fa2b-8ffc-4c5e-82ec-55eff1024bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a66fa2b-8ffc-4c5e-82ec-55eff1024bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-697582031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=058eac59-0908-4663-9d14-607f70a1a704,host='devstack@QuobyteHD#QuobyteHD',id=1af15220-58bc-4c18-a27a-314368afeb45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52433e1f8277445ab32197d15742d857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:58Z,use_quota=True,user_id='db8b90bf0dcc4f35a3a375a20c5ead4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e55400a-230c-41a7-9929-986e7202fd2b),volume_type_id=5e55400a-230c-41a7-9929-986e7202fd2b)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fdaab12-038f-4409-ae71-20c13c41e3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fdaab12-038f-4409-ae71-20c13c41e3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52b600b-54d3-47b2-89f7-dd8e2873f1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52b600b-54d3-47b2-89f7-dd8e2873f1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1af15220-58bc-4c18-a27a-314368afeb45', 'volume_name': 'volume-1af15220-58bc-4c18-a27a-314368afeb45', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f945af05-53b7-4b6d-bde8-a6859fe38c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f945af05-53b7-4b6d-bde8-a6859fe38c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f902954-8f7f-4d9f-9ec4-e14c3cd53612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:58 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Volume 1af15220-58bc-4c18-a27a-314368afeb45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1af15220-58bc-4c18-a27a-314368afeb45', 'volume_size': 1} Sep 04 15:56:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=058eac59-0908-4663-9d14-607f70a1a704,created_at=2026-09-04T13:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-697582031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=058eac59-0908-4663-9d14-607f70a1a704,host='devstack@QuobyteHD#QuobyteHD',id=1af15220-58bc-4c18-a27a-314368afeb45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52433e1f8277445ab32197d15742d857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:56:58Z,use_quota=True,user_id='db8b90bf0dcc4f35a3a375a20c5ead4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e55400a-230c-41a7-9929-986e7202fd2b),volume_type_id=5e55400a-230c-41a7-9929-986e7202fd2b)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:56:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Creating volume 1af15220-58bc-4c18-a27a-314368afeb45 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:56:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:56:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:56:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:56:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:56:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:56:58 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:56:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1af15220-58bc-4c18-a27a-314368afeb45 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:58 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1af15220-58bc-4c18-a27a-314368afeb45 1073741824 Sep 04 15:56:58 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:58 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1af15220-58bc-4c18-a27a-314368afeb45 1073741824" returned: 0 in 0.653s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1af15220-58bc-4c18-a27a-314368afeb45 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:56:58 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1af15220-58bc-4c18-a27a-314368afeb45 Sep 04 15:56:58 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:56:59 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Sep 04 15:56:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1af15220-58bc-4c18-a27a-314368afeb45" returned: 0 in 0.374s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:56:59 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:56:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:56:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f902954-8f7f-4d9f-9ec4-e14c3cd53612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1af15220-58bc-4c18-a27a-314368afeb45', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (015cc580-8e4c-4bc3-a3c1-f55832e7d0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:56:59 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Volume volume-1af15220-58bc-4c18-a27a-314368afeb45 (1af15220-58bc-4c18-a27a-314368afeb45): created successfully Sep 04 15:56:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (015cc580-8e4c-4bc3-a3c1-f55832e7d0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:56:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Flow 'volume_create_manager' (296c83c5-b170-4665-a484-3ff4cf77419a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:56:59 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-373cae95-7867-4468-936b-d695b5ef55c9 tempest-GroupsTest-29711870 None] Created volume successfully. Sep 04 15:57:01 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:57:01 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Flow 'volume_create_manager' (99b0fecc-c829-41ee-bf9b-b8efc0d54663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:57:01 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3724f2a3-3513-417b-b6cb-2bc5cc2760f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:01 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3724f2a3-3513-417b-b6cb-2bc5cc2760f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1854305095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=058eac59-0908-4663-9d14-607f70a1a704,host='devstack@QuobyteHD#QuobyteHD',id=8420f263-a128-4803-86cf-6caf1ebba4ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52433e1f8277445ab32197d15742d857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:01Z,use_quota=True,user_id='db8b90bf0dcc4f35a3a375a20c5ead4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e55400a-230c-41a7-9929-986e7202fd2b),volume_type_id=5e55400a-230c-41a7-9929-986e7202fd2b)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:01 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94865953-67e3-439b-95a8-67baec80fc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:01 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94865953-67e3-439b-95a8-67baec80fc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:01 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc905d13-25c7-45f1-bd0b-61f3cafc2987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:01 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc905d13-25c7-45f1-bd0b-61f3cafc2987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8420f263-a128-4803-86cf-6caf1ebba4ac', 'volume_name': 'volume-8420f263-a128-4803-86cf-6caf1ebba4ac', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:01 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb07639-288f-4445-881b-acf03a741e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:01 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb07639-288f-4445-881b-acf03a741e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:01 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6f3fd5-1499-43ad-a226-5c39cda40156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:01 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Volume 8420f263-a128-4803-86cf-6caf1ebba4ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8420f263-a128-4803-86cf-6caf1ebba4ac', 'volume_size': 1} Sep 04 15:57:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:01 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=058eac59-0908-4663-9d14-607f70a1a704,created_at=2026-09-04T13:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1854305095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=058eac59-0908-4663-9d14-607f70a1a704,host='devstack@QuobyteHD#QuobyteHD',id=8420f263-a128-4803-86cf-6caf1ebba4ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52433e1f8277445ab32197d15742d857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:01Z,use_quota=True,user_id='db8b90bf0dcc4f35a3a375a20c5ead4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e55400a-230c-41a7-9929-986e7202fd2b),volume_type_id=5e55400a-230c-41a7-9929-986e7202fd2b)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:57:01 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Creating volume 8420f263-a128-4803-86cf-6caf1ebba4ac {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:57:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:01 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:57:01 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:57:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:01 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:57:01 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:57:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8420f263-a128-4803-86cf-6caf1ebba4ac 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:01 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8420f263-a128-4803-86cf-6caf1ebba4ac 1073741824 Sep 04 15:57:01 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:02 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8420f263-a128-4803-86cf-6caf1ebba4ac 1073741824" returned: 0 in 0.542s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8420f263-a128-4803-86cf-6caf1ebba4ac {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:02 devstack sudo[98186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8420f263-a128-4803-86cf-6caf1ebba4ac Sep 04 15:57:02 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:02 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8420f263-a128-4803-86cf-6caf1ebba4ac" returned: 0 in 0.325s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:02 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:57:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6f3fd5-1499-43ad-a226-5c39cda40156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8420f263-a128-4803-86cf-6caf1ebba4ac', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67bcf17-5c1e-4607-ab41-a22815e8494f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:02 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Volume volume-8420f263-a128-4803-86cf-6caf1ebba4ac (8420f263-a128-4803-86cf-6caf1ebba4ac): created successfully Sep 04 15:57:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67bcf17-5c1e-4607-ab41-a22815e8494f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Flow 'volume_create_manager' (99b0fecc-c829-41ee-bf9b-b8efc0d54663) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:57:02 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-4be90d31-d4d2-4407-add4-7b88bc7e95b3 tempest-GroupsTest-29711870 None] Created volume successfully. Sep 04 15:57:02 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-416b4927-ec01-4057-9b9e-b8b4e8342821 tempest-GroupsTest-29711870 None] Update group completed successfully. Sep 04 15:57:03 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:57:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Flow 'volume_create_manager' (0848c00c-6d1a-42ef-a459-652c2e5d5be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:57:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb372a90-8f27-4b0d-9817-1f3616455df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb372a90-8f27-4b0d-9817-1f3616455df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2131495736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640f3b2c-3069-48dc-9b14-804ba60cce72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52dfd9584a71412b91d00105b26c936d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:03Z,use_quota=True,user_id='a8b747ae16e54443b7e827bb19b80ed0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b06834-b2da-4dd3-bdd7-fa44d3a7b14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b06834-b2da-4dd3-bdd7-fa44d3a7b14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2da42cf0-c924-4ae1-8274-90286121e14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2da42cf0-c924-4ae1-8274-90286121e14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '640f3b2c-3069-48dc-9b14-804ba60cce72', 'volume_name': 'volume-640f3b2c-3069-48dc-9b14-804ba60cce72', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a77110-7473-4162-b2fe-313340188e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a77110-7473-4162-b2fe-313340188e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf053cf-9bac-41a5-a676-a153c923ebc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:03 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Volume 640f3b2c-3069-48dc-9b14-804ba60cce72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-640f3b2c-3069-48dc-9b14-804ba60cce72', 'volume_size': 1} Sep 04 15:57:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2131495736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640f3b2c-3069-48dc-9b14-804ba60cce72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52dfd9584a71412b91d00105b26c936d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:03Z,use_quota=True,user_id='a8b747ae16e54443b7e827bb19b80ed0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:57:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Creating volume 640f3b2c-3069-48dc-9b14-804ba60cce72 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:57:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:57:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:57:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:57:03 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:57:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-640f3b2c-3069-48dc-9b14-804ba60cce72 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:03 devstack sudo[98189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-640f3b2c-3069-48dc-9b14-804ba60cce72 1073741824 Sep 04 15:57:03 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:03 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-640f3b2c-3069-48dc-9b14-804ba60cce72 1073741824" returned: 0 in 0.481s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-640f3b2c-3069-48dc-9b14-804ba60cce72 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:03 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-640f3b2c-3069-48dc-9b14-804ba60cce72 Sep 04 15:57:03 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:04 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-640f3b2c-3069-48dc-9b14-804ba60cce72" returned: 0 in 0.290s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:04 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:57:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf053cf-9bac-41a5-a676-a153c923ebc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-640f3b2c-3069-48dc-9b14-804ba60cce72', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d971b4-6c0c-4da6-9e2b-4ce66aea2362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:04 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Volume volume-640f3b2c-3069-48dc-9b14-804ba60cce72 (640f3b2c-3069-48dc-9b14-804ba60cce72): created successfully Sep 04 15:57:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d971b4-6c0c-4da6-9e2b-4ce66aea2362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Flow 'volume_create_manager' (0848c00c-6d1a-42ef-a459-652c2e5d5be5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:57:04 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-a77fb227-76e9-4442-a42a-6224e6b1462a tempest-VolumesTransfersV355Test-856148534 None] Created volume successfully. Sep 04 15:57:04 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-2e78697c-8d0e-4bde-bafd-bbe23f16b543 tempest-GroupsTest-29711870 None] Update group completed successfully. Sep 04 15:57:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] Acquiring lock "cinder-quobyte-1af15220-58bc-4c18-a27a-314368afeb45" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] Lock "cinder-quobyte-1af15220-58bc-4c18-a27a-314368afeb45" acquired by "delete_volume" :: waited 0.035s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:06 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cd17e7-b5ea-4f80-908f-165ab474a7ff]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1af15220-58bc-4c18-a27a-314368afeb45 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:06 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-3aebf554-b9cc-4b52-b422-12314a906003 tempest-VolumesTransfersV355Test-1850163100 None] Transfer volume completed successfully. Sep 04 15:57:06 devstack sudo[98198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1af15220-58bc-4c18-a27a-314368afeb45 Sep 04 15:57:06 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:06 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1af15220-58bc-4c18-a27a-314368afeb45" returned: 0 in 0.551s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1af15220-58bc-4c18-a27a-314368afeb45 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:06 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1af15220-58bc-4c18-a27a-314368afeb45 Sep 04 15:57:06 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b5eedbc4-8c81-4f06-a84f-597e277bade2 tempest-VolumesTransfersV355Test-870612027 None] Acquiring lock "cinder-640f3b2c-3069-48dc-9b14-804ba60cce72-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1af15220-58bc-4c18-a27a-314368afeb45" returned: 0 in 0.342s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:07 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b5eedbc4-8c81-4f06-a84f-597e277bade2 tempest-VolumesTransfersV355Test-870612027 None] Lock "cinder-640f3b2c-3069-48dc-9b14-804ba60cce72-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] Lock "cinder-quobyte-1af15220-58bc-4c18-a27a-314368afeb45" released by "delete_volume" :: held 0.965s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] Acquiring lock "cinder-quobyte-8420f263-a128-4803-86cf-6caf1ebba4ac" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] Lock "cinder-quobyte-8420f263-a128-4803-86cf-6caf1ebba4ac" acquired by "delete_volume" :: waited 0.030s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:07 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1ffbe0-7813-4bae-9896-f0c469379812]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8420f263-a128-4803-86cf-6caf1ebba4ac {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b5eedbc4-8c81-4f06-a84f-597e277bade2 tempest-VolumesTransfersV355Test-870612027 None] Acquiring lock "cinder-quobyte-640f3b2c-3069-48dc-9b14-804ba60cce72" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b5eedbc4-8c81-4f06-a84f-597e277bade2 tempest-VolumesTransfersV355Test-870612027 None] Lock "cinder-quobyte-640f3b2c-3069-48dc-9b14-804ba60cce72" acquired by "delete_volume" :: waited 0.019s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:07 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb5583c-9020-4e85-b806-bd687ef96e16]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b5eedbc4-8c81-4f06-a84f-597e277bade2 tempest-VolumesTransfersV355Test-870612027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-640f3b2c-3069-48dc-9b14-804ba60cce72 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:07 devstack sudo[98206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8420f263-a128-4803-86cf-6caf1ebba4ac Sep 04 15:57:07 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:07 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-640f3b2c-3069-48dc-9b14-804ba60cce72 Sep 04 15:57:07 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:07 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8420f263-a128-4803-86cf-6caf1ebba4ac" returned: 0 in 0.552s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8420f263-a128-4803-86cf-6caf1ebba4ac {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:07 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8420f263-a128-4803-86cf-6caf1ebba4ac Sep 04 15:57:07 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:07 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b5eedbc4-8c81-4f06-a84f-597e277bade2 tempest-VolumesTransfersV355Test-870612027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-640f3b2c-3069-48dc-9b14-804ba60cce72" returned: 0 in 0.556s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b5eedbc4-8c81-4f06-a84f-597e277bade2 tempest-VolumesTransfersV355Test-870612027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-640f3b2c-3069-48dc-9b14-804ba60cce72 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:08 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-640f3b2c-3069-48dc-9b14-804ba60cce72 Sep 04 15:57:08 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:08 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8420f263-a128-4803-86cf-6caf1ebba4ac" returned: 0 in 0.371s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:08 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] Lock "cinder-quobyte-8420f263-a128-4803-86cf-6caf1ebba4ac" released by "delete_volume" :: held 0.981s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:08 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b5eedbc4-8c81-4f06-a84f-597e277bade2 tempest-VolumesTransfersV355Test-870612027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-640f3b2c-3069-48dc-9b14-804ba60cce72" returned: 0 in 0.358s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:08 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b5eedbc4-8c81-4f06-a84f-597e277bade2 tempest-VolumesTransfersV355Test-870612027 None] Lock "cinder-quobyte-640f3b2c-3069-48dc-9b14-804ba60cce72" released by "delete_volume" :: held 0.976s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:08 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-b5eedbc4-8c81-4f06-a84f-597e277bade2 tempest-VolumesTransfersV355Test-870612027 None] Created reservations ['35900ddf-7de7-49f1-9ced-5e9f10ba0ce5', 'bc27c37e-a198-4f2a-ac30-4087d161dc84', '611742ef-e4d6-4604-9a92-f281f8860dc8', '399d48c9-b83f-4df7-8b50-c96c0d7f990c'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:57:08 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] Created reservations ['741fc7b2-978d-4019-b779-bc71f6b8ddb2'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:57:08 devstack cinder-volume[87490]: WARNING cinder.quota [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2056652374 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2056652374, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:57:08 devstack cinder-volume[87490]: WARNING cinder.quota [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2056652374 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2056652374, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:57:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b5eedbc4-8c81-4f06-a84f-597e277bade2 tempest-VolumesTransfersV355Test-870612027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b5eedbc4-8c81-4f06-a84f-597e277bade2 tempest-VolumesTransfersV355Test-870612027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:08 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b5eedbc4-8c81-4f06-a84f-597e277bade2 tempest-VolumesTransfersV355Test-870612027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:57:08 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b5eedbc4-8c81-4f06-a84f-597e277bade2 tempest-VolumesTransfersV355Test-870612027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:57:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b5eedbc4-8c81-4f06-a84f-597e277bade2 tempest-VolumesTransfersV355Test-870612027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b5eedbc4-8c81-4f06-a84f-597e277bade2 tempest-VolumesTransfersV355Test-870612027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:08 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] Created reservations ['3876d0cf-34da-496a-a0d1-20a054264d7a', 'aaa52f20-1e0c-41a7-a553-d5dec100e648', 'eba5174c-7b84-44df-8880-fd92563f3eb9', 'e0c0e375-b0c4-4d61-a027-2389cce398c7'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:57:08 devstack sudo[98223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:57:08 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:08 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] Created reservations ['9faedf81-b029-4311-b93b-6d08ff98a11e', 'bdb1a0eb-815b-4a09-a045-29a3d61c95e1', 'fd5f6011-4d97-4114-95ed-69af88b928a8', 'bd778cc1-65ca-4044-ae97-434b9281716c'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:57:08 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b5eedbc4-8c81-4f06-a84f-597e277bade2 tempest-VolumesTransfersV355Test-870612027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.418s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:08 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-b5eedbc4-8c81-4f06-a84f-597e277bade2 tempest-VolumesTransfersV355Test-870612027 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:57:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:08 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:57:08 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:57:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:08 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-b5eedbc4-8c81-4f06-a84f-597e277bade2 tempest-VolumesTransfersV355Test-870612027 None] Deleted volume successfully. Sep 04 15:57:09 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:57:09 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b5eedbc4-8c81-4f06-a84f-597e277bade2 tempest-VolumesTransfersV355Test-870612027 None] Lock "cinder-640f3b2c-3069-48dc-9b14-804ba60cce72-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:09 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:09 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.288s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:09 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:57:09 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-a828d73c-d2c3-45a8-a89b-1e2cbdc2ee3a tempest-GroupsTest-29711870 None] Delete group completed successfully. Sep 04 15:57:10 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:57:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Flow 'volume_create_manager' (07ee6291-768b-4575-8299-4953462f4db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:57:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e39395-01a9-4740-95ea-97036780f060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e39395-01a9-4740-95ea-97036780f060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1494910975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0794ff40-082c-4b45-a38c-67760fc31daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52dfd9584a71412b91d00105b26c936d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:10Z,use_quota=True,user_id='a8b747ae16e54443b7e827bb19b80ed0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37535ff6-cc7b-4150-b904-97f621b55a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37535ff6-cc7b-4150-b904-97f621b55a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6692f0-0fe2-4689-9231-6c26ac5e06e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6692f0-0fe2-4689-9231-6c26ac5e06e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0794ff40-082c-4b45-a38c-67760fc31daa', 'volume_name': 'volume-0794ff40-082c-4b45-a38c-67760fc31daa', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3148f54f-f7a2-43c2-80d9-c970a8d337d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3148f54f-f7a2-43c2-80d9-c970a8d337d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a07d78a-f220-4865-90e7-f1f7d029fa20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:10 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Volume 0794ff40-082c-4b45-a38c-67760fc31daa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0794ff40-082c-4b45-a38c-67760fc31daa', 'volume_size': 1} Sep 04 15:57:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1494910975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0794ff40-082c-4b45-a38c-67760fc31daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52dfd9584a71412b91d00105b26c936d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:10Z,use_quota=True,user_id='a8b747ae16e54443b7e827bb19b80ed0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:57:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Creating volume 0794ff40-082c-4b45-a38c-67760fc31daa {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:57:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:57:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:57:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:57:10 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:57:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0794ff40-082c-4b45-a38c-67760fc31daa 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:10 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0794ff40-082c-4b45-a38c-67760fc31daa 1073741824 Sep 04 15:57:10 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:10 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0794ff40-082c-4b45-a38c-67760fc31daa 1073741824" returned: 0 in 0.513s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0794ff40-082c-4b45-a38c-67760fc31daa {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:10 devstack sudo[98237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0794ff40-082c-4b45-a38c-67760fc31daa Sep 04 15:57:10 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:11 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0794ff40-082c-4b45-a38c-67760fc31daa" returned: 0 in 0.332s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:11 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:57:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:11 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a07d78a-f220-4865-90e7-f1f7d029fa20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0794ff40-082c-4b45-a38c-67760fc31daa', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:11 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e5acd6-9895-4fc4-bbc1-0fd3836935d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:11 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Volume volume-0794ff40-082c-4b45-a38c-67760fc31daa (0794ff40-082c-4b45-a38c-67760fc31daa): created successfully Sep 04 15:57:11 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e5acd6-9895-4fc4-bbc1-0fd3836935d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:11 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Flow 'volume_create_manager' (07ee6291-768b-4575-8299-4953462f4db9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:57:11 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-c816f53c-46d7-4339-933d-c013bbf53618 tempest-VolumesTransfersV355Test-856148534 None] Created volume successfully. Sep 04 15:57:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b69581e9-bfd9-4fca-89bd-dd5c677b22d1 tempest-VolumesTransfersV355Test-870612027 None] Acquiring lock "cinder-0794ff40-082c-4b45-a38c-67760fc31daa-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b69581e9-bfd9-4fca-89bd-dd5c677b22d1 tempest-VolumesTransfersV355Test-870612027 None] Lock "cinder-0794ff40-082c-4b45-a38c-67760fc31daa-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b69581e9-bfd9-4fca-89bd-dd5c677b22d1 tempest-VolumesTransfersV355Test-870612027 None] Acquiring lock "cinder-quobyte-0794ff40-082c-4b45-a38c-67760fc31daa" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b69581e9-bfd9-4fca-89bd-dd5c677b22d1 tempest-VolumesTransfersV355Test-870612027 None] Lock "cinder-quobyte-0794ff40-082c-4b45-a38c-67760fc31daa" acquired by "delete_volume" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:12 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31c27cd-17ea-462f-bf88-2a722fcd8f59]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b69581e9-bfd9-4fca-89bd-dd5c677b22d1 tempest-VolumesTransfersV355Test-870612027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0794ff40-082c-4b45-a38c-67760fc31daa {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:12 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0794ff40-082c-4b45-a38c-67760fc31daa Sep 04 15:57:12 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:13 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b69581e9-bfd9-4fca-89bd-dd5c677b22d1 tempest-VolumesTransfersV355Test-870612027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0794ff40-082c-4b45-a38c-67760fc31daa" returned: 0 in 0.487s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b69581e9-bfd9-4fca-89bd-dd5c677b22d1 tempest-VolumesTransfersV355Test-870612027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0794ff40-082c-4b45-a38c-67760fc31daa {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:13 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0794ff40-082c-4b45-a38c-67760fc31daa Sep 04 15:57:13 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:13 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b69581e9-bfd9-4fca-89bd-dd5c677b22d1 tempest-VolumesTransfersV355Test-870612027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0794ff40-082c-4b45-a38c-67760fc31daa" returned: 0 in 0.266s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:13 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b69581e9-bfd9-4fca-89bd-dd5c677b22d1 tempest-VolumesTransfersV355Test-870612027 None] Lock "cinder-quobyte-0794ff40-082c-4b45-a38c-67760fc31daa" released by "delete_volume" :: held 0.798s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:13 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-b69581e9-bfd9-4fca-89bd-dd5c677b22d1 tempest-VolumesTransfersV355Test-870612027 None] Created reservations ['232cec48-3035-44a0-9797-377b9da3197f', '6e056abb-4cf3-423c-bd44-743a5b7988d1', '6d5cdb7a-8a11-4523-b9e6-6194e8bc781d', '04ad3d7d-1c0b-4e7d-a9d2-3efbeb18b7c1'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:57:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b69581e9-bfd9-4fca-89bd-dd5c677b22d1 tempest-VolumesTransfersV355Test-870612027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b69581e9-bfd9-4fca-89bd-dd5c677b22d1 tempest-VolumesTransfersV355Test-870612027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b69581e9-bfd9-4fca-89bd-dd5c677b22d1 tempest-VolumesTransfersV355Test-870612027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:57:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b69581e9-bfd9-4fca-89bd-dd5c677b22d1 tempest-VolumesTransfersV355Test-870612027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:57:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b69581e9-bfd9-4fca-89bd-dd5c677b22d1 tempest-VolumesTransfersV355Test-870612027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b69581e9-bfd9-4fca-89bd-dd5c677b22d1 tempest-VolumesTransfersV355Test-870612027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:13 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:57:13 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:14 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b69581e9-bfd9-4fca-89bd-dd5c677b22d1 tempest-VolumesTransfersV355Test-870612027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.519s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:14 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-b69581e9-bfd9-4fca-89bd-dd5c677b22d1 tempest-VolumesTransfersV355Test-870612027 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:57:14 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-b69581e9-bfd9-4fca-89bd-dd5c677b22d1 tempest-VolumesTransfersV355Test-870612027 None] Deleted volume successfully. Sep 04 15:57:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b69581e9-bfd9-4fca-89bd-dd5c677b22d1 tempest-VolumesTransfersV355Test-870612027 None] Lock "cinder-0794ff40-082c-4b45-a38c-67760fc31daa-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:16 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:57:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Flow 'volume_create_manager' (946eed23-db21-41b0-a69d-b26f64e2991d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:57:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6630b6c8-feab-4b6b-9ac3-969066b5bb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6630b6c8-feab-4b6b-9ac3-969066b5bb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-976491402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7ae0227-7503-4b7c-a4b0-50edcda84d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='479f09ac2c184c53a3a7c8da190ac521',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:17Z,use_quota=True,user_id='d35e1d12331449c88fdb6926f6d6f220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa70b38-3f1f-4349-bbe0-333e8c6b7929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa70b38-3f1f-4349-bbe0-333e8c6b7929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c61efe33-8cc8-4b0c-aac8-5c7b4e2de92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c61efe33-8cc8-4b0c-aac8-5c7b4e2de92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7ae0227-7503-4b7c-a4b0-50edcda84d6d', 'volume_name': 'volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7103fc8d-e4a2-4271-9efa-036aefb9d744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7103fc8d-e4a2-4271-9efa-036aefb9d744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f1130f-248a-47ed-9c4d-9c8e61c75571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:16 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Volume a7ae0227-7503-4b7c-a4b0-50edcda84d6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d', 'volume_size': 1} Sep 04 15:57:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-976491402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7ae0227-7503-4b7c-a4b0-50edcda84d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='479f09ac2c184c53a3a7c8da190ac521',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:17Z,use_quota=True,user_id='d35e1d12331449c88fdb6926f6d6f220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:57:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Creating volume a7ae0227-7503-4b7c-a4b0-50edcda84d6d {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:57:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:57:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:57:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:57:16 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:57:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:16 devstack sudo[98252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d 1073741824 Sep 04 15:57:16 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:17 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d 1073741824" returned: 0 in 0.699s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:17 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d Sep 04 15:57:17 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:17 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d" returned: 0 in 0.345s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:17 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:57:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f1130f-248a-47ed-9c4d-9c8e61c75571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a392511-0531-4777-bc02-832989b2b3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:17 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Volume volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d (a7ae0227-7503-4b7c-a4b0-50edcda84d6d): created successfully Sep 04 15:57:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a392511-0531-4777-bc02-832989b2b3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Flow 'volume_create_manager' (946eed23-db21-41b0-a69d-b26f64e2991d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:57:17 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-e4d06529-3cec-4aae-add2-7e3769a41dab tempest-SnapshotsActionsTest-1135109523 None] Created volume successfully. Sep 04 15:57:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-72a7d8e7-0e72-41ad-87e3-df42f7a48a9f tempest-SnapshotsActionsTest-1135109523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-72a7d8e7-0e72-41ad-87e3-df42f7a48a9f tempest-SnapshotsActionsTest-1135109523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-72a7d8e7-0e72-41ad-87e3-df42f7a48a9f tempest-SnapshotsActionsTest-1135109523 None] Creating offline snapshot cfa1489d-a666-4efb-8564-8cf1f69e1a9c of volume a7ae0227-7503-4b7c-a4b0-50edcda84d6d {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:57:19 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bce6b56-e1f4-42b0-853c-b534df2843d1]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-72a7d8e7-0e72-41ad-87e3-df42f7a48a9f tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:19 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d Sep 04 15:57:19 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:19 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-72a7d8e7-0e72-41ad-87e3-df42f7a48a9f tempest-SnapshotsActionsTest-1135109523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d" returned: 0 in 0.466s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-72a7d8e7-0e72-41ad-87e3-df42f7a48a9f tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:19 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c 1G Sep 04 15:57:19 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:20 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-72a7d8e7-0e72-41ad-87e3-df42f7a48a9f tempest-SnapshotsActionsTest-1135109523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c 1G" returned: 0 in 0.584s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-72a7d8e7-0e72-41ad-87e3-df42f7a48a9f tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:20 devstack sudo[98278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c Sep 04 15:57:20 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:20 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-72a7d8e7-0e72-41ad-87e3-df42f7a48a9f tempest-SnapshotsActionsTest-1135109523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c" returned: 0 in 0.457s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:20 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-72a7d8e7-0e72-41ad-87e3-df42f7a48a9f tempest-SnapshotsActionsTest-1135109523 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c is being set with open permissions: ugo+rw Sep 04 15:57:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-72a7d8e7-0e72-41ad-87e3-df42f7a48a9f tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:20 devstack sudo[98283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c Sep 04 15:57:20 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:20 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-72a7d8e7-0e72-41ad-87e3-df42f7a48a9f tempest-SnapshotsActionsTest-1135109523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c" returned: 0 in 0.351s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-72a7d8e7-0e72-41ad-87e3-df42f7a48a9f tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:21 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.info Sep 04 15:57:21 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:21 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-72a7d8e7-0e72-41ad-87e3-df42f7a48a9f tempest-SnapshotsActionsTest-1135109523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.info" returned: 0 in 0.370s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:21 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-72a7d8e7-0e72-41ad-87e3-df42f7a48a9f tempest-SnapshotsActionsTest-1135109523 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.info is being set with open permissions: ugo+rw Sep 04 15:57:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-72a7d8e7-0e72-41ad-87e3-df42f7a48a9f tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:21 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.info Sep 04 15:57:21 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:21 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-72a7d8e7-0e72-41ad-87e3-df42f7a48a9f tempest-SnapshotsActionsTest-1135109523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.info" returned: 0 in 0.408s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-72a7d8e7-0e72-41ad-87e3-df42f7a48a9f tempest-SnapshotsActionsTest-1135109523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.798s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:21 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-72a7d8e7-0e72-41ad-87e3-df42f7a48a9f tempest-SnapshotsActionsTest-1135109523 None] Create snapshot completed successfully Sep 04 15:57:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5e5edcfd-131d-4114-a72c-01d680852627 tempest-SnapshotsActionsTest-1135109523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5e5edcfd-131d-4114-a72c-01d680852627 tempest-SnapshotsActionsTest-1135109523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:23 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-5e5edcfd-131d-4114-a72c-01d680852627 tempest-SnapshotsActionsTest-1135109523 None] Creating offline snapshot 182d7ef6-057d-44b7-b99a-f3a5e342e317 of volume a7ae0227-7503-4b7c-a4b0-50edcda84d6d {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:57:23 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[71602c91-07b4-4cd4-a2e5-0b0923fbf297]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5e5edcfd-131d-4114-a72c-01d680852627 tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:23 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c Sep 04 15:57:23 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:24 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5e5edcfd-131d-4114-a72c-01d680852627 tempest-SnapshotsActionsTest-1135109523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c" returned: 0 in 0.747s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:24 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-5e5edcfd-131d-4114-a72c-01d680852627 tempest-SnapshotsActionsTest-1135109523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:57:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5e5edcfd-131d-4114-a72c-01d680852627 tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.182d7ef6-057d-44b7-b99a-f3a5e342e317 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:24 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.182d7ef6-057d-44b7-b99a-f3a5e342e317 1G Sep 04 15:57:24 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:24 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-bd29633d-0a55-4c69-971d-bdfda2fdb556 req-34521d5c-4ad1-455c-ba0b-4a95ea031cde tempest-TestMinimumBasicScenario-1371772703 None] Terminate volume connection completed successfully. Sep 04 15:57:24 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-bd29633d-0a55-4c69-971d-bdfda2fdb556 req-34521d5c-4ad1-455c-ba0b-4a95ea031cde tempest-TestMinimumBasicScenario-1371772703 None] Deleting attachment abe4e7ff-e308-47b2-b8db-e2e73c79d3ed. {{(pid=87490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 15:57:24 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5e5edcfd-131d-4114-a72c-01d680852627 tempest-SnapshotsActionsTest-1135109523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.182d7ef6-057d-44b7-b99a-f3a5e342e317 1G" returned: 0 in 0.695s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5e5edcfd-131d-4114-a72c-01d680852627 tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.182d7ef6-057d-44b7-b99a-f3a5e342e317 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:24 devstack sudo[98319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.182d7ef6-057d-44b7-b99a-f3a5e342e317 Sep 04 15:57:24 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:25 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5e5edcfd-131d-4114-a72c-01d680852627 tempest-SnapshotsActionsTest-1135109523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.182d7ef6-057d-44b7-b99a-f3a5e342e317" returned: 0 in 0.575s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:25 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-5e5edcfd-131d-4114-a72c-01d680852627 tempest-SnapshotsActionsTest-1135109523 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.182d7ef6-057d-44b7-b99a-f3a5e342e317 is being set with open permissions: ugo+rw Sep 04 15:57:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5e5edcfd-131d-4114-a72c-01d680852627 tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.182d7ef6-057d-44b7-b99a-f3a5e342e317 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:25 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.182d7ef6-057d-44b7-b99a-f3a5e342e317 Sep 04 15:57:25 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:25 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7c2a2ddd-b21f-4530-80f9-66e7b1f4f95e tempest-TestMinimumBasicScenario-1371772703 None] Acquiring lock "cinder-fe14c9d1-5480-4702-a594-d29bd7a71618-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:25 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7c2a2ddd-b21f-4530-80f9-66e7b1f4f95e tempest-TestMinimumBasicScenario-1371772703 None] Lock "cinder-fe14c9d1-5480-4702-a594-d29bd7a71618-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:25 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7c2a2ddd-b21f-4530-80f9-66e7b1f4f95e tempest-TestMinimumBasicScenario-1371772703 None] Acquiring lock "cinder-quobyte-fe14c9d1-5480-4702-a594-d29bd7a71618" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:25 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7c2a2ddd-b21f-4530-80f9-66e7b1f4f95e tempest-TestMinimumBasicScenario-1371772703 None] Lock "cinder-quobyte-fe14c9d1-5480-4702-a594-d29bd7a71618" acquired by "delete_volume" :: waited 0.016s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:25 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3e2493-814f-4e56-b7ef-8a5187d6ef8f]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7c2a2ddd-b21f-4530-80f9-66e7b1f4f95e tempest-TestMinimumBasicScenario-1371772703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fe14c9d1-5480-4702-a594-d29bd7a71618 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:25 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5e5edcfd-131d-4114-a72c-01d680852627 tempest-SnapshotsActionsTest-1135109523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.182d7ef6-057d-44b7-b99a-f3a5e342e317" returned: 0 in 0.415s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5e5edcfd-131d-4114-a72c-01d680852627 tempest-SnapshotsActionsTest-1135109523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.585s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:25 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fe14c9d1-5480-4702-a594-d29bd7a71618 Sep 04 15:57:25 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:25 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-5e5edcfd-131d-4114-a72c-01d680852627 tempest-SnapshotsActionsTest-1135109523 None] Create snapshot completed successfully Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Flow 'volume_create_manager' (aa3786e1-9bff-4b29-a15b-0ffc22c5842a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d808f1a-4919-435e-8374-d49f7351befe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:26 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7c2a2ddd-b21f-4530-80f9-66e7b1f4f95e tempest-TestMinimumBasicScenario-1371772703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fe14c9d1-5480-4702-a594-d29bd7a71618" returned: 0 in 0.477s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7c2a2ddd-b21f-4530-80f9-66e7b1f4f95e tempest-TestMinimumBasicScenario-1371772703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fe14c9d1-5480-4702-a594-d29bd7a71618 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d808f1a-4919-435e-8374-d49f7351befe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-343520902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36af25a-8205-4d8a-9400-d1eb1c43ae8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5170a582e466443ca46013897735c431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:26Z,use_quota=True,user_id='cc601916f5aa4f889fae1756cd03b4c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83508c86-eba3-44a2-a120-5eda451bf610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83508c86-eba3-44a2-a120-5eda451bf610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d5ad2e-5955-441e-8123-42999fd55648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:26 devstack sudo[98369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fe14c9d1-5480-4702-a594-d29bd7a71618 Sep 04 15:57:26 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d5ad2e-5955-441e-8123-42999fd55648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e36af25a-8205-4d8a-9400-d1eb1c43ae8e', 'volume_name': 'volume-e36af25a-8205-4d8a-9400-d1eb1c43ae8e', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a7f98e-f166-4f3c-9037-45409cd6d5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a7f98e-f166-4f3c-9037-45409cd6d5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (830a2499-4634-4c95-b0c6-bf695608140b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:26 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Volume e36af25a-8205-4d8a-9400-d1eb1c43ae8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e36af25a-8205-4d8a-9400-d1eb1c43ae8e', 'volume_size': 1} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-343520902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36af25a-8205-4d8a-9400-d1eb1c43ae8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5170a582e466443ca46013897735c431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:26Z,use_quota=True,user_id='cc601916f5aa4f889fae1756cd03b4c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Creating volume e36af25a-8205-4d8a-9400-d1eb1c43ae8e {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:57:26 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e36af25a-8205-4d8a-9400-d1eb1c43ae8e 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:26 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e36af25a-8205-4d8a-9400-d1eb1c43ae8e 1073741824 Sep 04 15:57:26 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:26 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7c2a2ddd-b21f-4530-80f9-66e7b1f4f95e tempest-TestMinimumBasicScenario-1371772703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fe14c9d1-5480-4702-a594-d29bd7a71618" returned: 0 in 0.311s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7c2a2ddd-b21f-4530-80f9-66e7b1f4f95e tempest-TestMinimumBasicScenario-1371772703 None] Lock "cinder-quobyte-fe14c9d1-5480-4702-a594-d29bd7a71618" released by "delete_volume" :: held 0.850s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-64ba9058-ba20-497e-9ab3-8497893b5602 tempest-SnapshotsActionsTest-1685438083 None] Acquiring lock "cinder-182d7ef6-057d-44b7-b99a-f3a5e342e317-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-7c2a2ddd-b21f-4530-80f9-66e7b1f4f95e tempest-TestMinimumBasicScenario-1371772703 None] Created reservations ['54337feb-ecfb-4835-a338-05d54fa0125f', 'cb4362a9-9c32-4a86-a987-21f1e4b2e70c', '0d4d07f7-6c30-4604-8573-5f4fa7dd1a6a', '246be8c7-38c0-4f26-a2d1-d82182c12f3b'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-64ba9058-ba20-497e-9ab3-8497893b5602 tempest-SnapshotsActionsTest-1685438083 None] Lock "cinder-182d7ef6-057d-44b7-b99a-f3a5e342e317-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-64ba9058-ba20-497e-9ab3-8497893b5602 tempest-SnapshotsActionsTest-1685438083 None] Acquiring lock "cinder-quobyte-a7ae0227-7503-4b7c-a4b0-50edcda84d6d" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-64ba9058-ba20-497e-9ab3-8497893b5602 tempest-SnapshotsActionsTest-1685438083 None] Lock "cinder-quobyte-a7ae0227-7503-4b7c-a4b0-50edcda84d6d" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-64ba9058-ba20-497e-9ab3-8497893b5602 tempest-SnapshotsActionsTest-1685438083 None] Acquiring lock "cinder-quobyte-182d7ef6-057d-44b7-b99a-f3a5e342e317" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-64ba9058-ba20-497e-9ab3-8497893b5602 tempest-SnapshotsActionsTest-1685438083 None] Lock "cinder-quobyte-182d7ef6-057d-44b7-b99a-f3a5e342e317" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-64ba9058-ba20-497e-9ab3-8497893b5602 tempest-SnapshotsActionsTest-1685438083 None] Deleting offline snapshot 182d7ef6-057d-44b7-b99a-f3a5e342e317 of volume a7ae0227-7503-4b7c-a4b0-50edcda84d6d {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-64ba9058-ba20-497e-9ab3-8497893b5602 tempest-SnapshotsActionsTest-1685438083 None] snapshot_file for this snap is: volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.182d7ef6-057d-44b7-b99a-f3a5e342e317 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bbce24-1506-4fef-a06f-6c0d42e4c3db]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-64ba9058-ba20-497e-9ab3-8497893b5602 tempest-SnapshotsActionsTest-1685438083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.182d7ef6-057d-44b7-b99a-f3a5e342e317 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7c2a2ddd-b21f-4530-80f9-66e7b1f4f95e tempest-TestMinimumBasicScenario-1371772703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7c2a2ddd-b21f-4530-80f9-66e7b1f4f95e tempest-TestMinimumBasicScenario-1371772703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7c2a2ddd-b21f-4530-80f9-66e7b1f4f95e tempest-TestMinimumBasicScenario-1371772703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7c2a2ddd-b21f-4530-80f9-66e7b1f4f95e tempest-TestMinimumBasicScenario-1371772703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7c2a2ddd-b21f-4530-80f9-66e7b1f4f95e tempest-TestMinimumBasicScenario-1371772703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7c2a2ddd-b21f-4530-80f9-66e7b1f4f95e tempest-TestMinimumBasicScenario-1371772703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:26 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:57:26 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:26 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e36af25a-8205-4d8a-9400-d1eb1c43ae8e 1073741824" returned: 0 in 0.633s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:26 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.182d7ef6-057d-44b7-b99a-f3a5e342e317 Sep 04 15:57:26 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e36af25a-8205-4d8a-9400-d1eb1c43ae8e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:26 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e36af25a-8205-4d8a-9400-d1eb1c43ae8e Sep 04 15:57:26 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:27 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7c2a2ddd-b21f-4530-80f9-66e7b1f4f95e tempest-TestMinimumBasicScenario-1371772703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.487s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:27 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-7c2a2ddd-b21f-4530-80f9-66e7b1f4f95e tempest-TestMinimumBasicScenario-1371772703 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:57:27 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-7c2a2ddd-b21f-4530-80f9-66e7b1f4f95e tempest-TestMinimumBasicScenario-1371772703 None] Deleted volume successfully. Sep 04 15:57:27 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7c2a2ddd-b21f-4530-80f9-66e7b1f4f95e tempest-TestMinimumBasicScenario-1371772703 None] Lock "cinder-fe14c9d1-5480-4702-a594-d29bd7a71618-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:27 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:27 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e36af25a-8205-4d8a-9400-d1eb1c43ae8e" returned: 0 in 0.430s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-64ba9058-ba20-497e-9ab3-8497893b5602 tempest-SnapshotsActionsTest-1685438083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.182d7ef6-057d-44b7-b99a-f3a5e342e317" returned: 0 in 0.665s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:27 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:57:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:27 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-64ba9058-ba20-497e-9ab3-8497893b5602 tempest-SnapshotsActionsTest-1685438083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:57:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (830a2499-4634-4c95-b0c6-bf695608140b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e36af25a-8205-4d8a-9400-d1eb1c43ae8e', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db12b956-f7a1-4fa1-b641-f058c6d34487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:27 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[65891209-e7b2-465a-a15d-4420788cf452]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-64ba9058-ba20-497e-9ab3-8497893b5602 tempest-SnapshotsActionsTest-1685438083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:27 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Volume volume-e36af25a-8205-4d8a-9400-d1eb1c43ae8e (e36af25a-8205-4d8a-9400-d1eb1c43ae8e): created successfully Sep 04 15:57:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db12b956-f7a1-4fa1-b641-f058c6d34487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Flow 'volume_create_manager' (aa3786e1-9bff-4b29-a15b-0ffc22c5842a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:57:27 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-142e39bd-9a09-44bc-a69b-be7174bc5b4e tempest-VolumesTransfersV357Test-1293591352 None] Created volume successfully. Sep 04 15:57:27 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c Sep 04 15:57:27 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:28 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-64ba9058-ba20-497e-9ab3-8497893b5602 tempest-SnapshotsActionsTest-1685438083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c" returned: 0 in 0.547s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:28 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-64ba9058-ba20-497e-9ab3-8497893b5602 tempest-SnapshotsActionsTest-1685438083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:57:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-64ba9058-ba20-497e-9ab3-8497893b5602 tempest-SnapshotsActionsTest-1685438083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.182d7ef6-057d-44b7-b99a-f3a5e342e317 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:28 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.182d7ef6-057d-44b7-b99a-f3a5e342e317 Sep 04 15:57:28 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:28 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-64ba9058-ba20-497e-9ab3-8497893b5602 tempest-SnapshotsActionsTest-1685438083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.182d7ef6-057d-44b7-b99a-f3a5e342e317" returned: 0 in 0.483s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-64ba9058-ba20-497e-9ab3-8497893b5602 tempest-SnapshotsActionsTest-1685438083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.182d7ef6-057d-44b7-b99a-f3a5e342e317 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:28 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.182d7ef6-057d-44b7-b99a-f3a5e342e317 Sep 04 15:57:28 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:28 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-64ba9058-ba20-497e-9ab3-8497893b5602 tempest-SnapshotsActionsTest-1685438083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.182d7ef6-057d-44b7-b99a-f3a5e342e317" returned: 0 in 0.286s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:28 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-64ba9058-ba20-497e-9ab3-8497893b5602 tempest-SnapshotsActionsTest-1685438083 None] Lock "cinder-quobyte-182d7ef6-057d-44b7-b99a-f3a5e342e317" released by "_delete_snapshot" :: held 2.232s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:28 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-64ba9058-ba20-497e-9ab3-8497893b5602 tempest-SnapshotsActionsTest-1685438083 None] Lock "cinder-quobyte-a7ae0227-7503-4b7c-a4b0-50edcda84d6d" released by "delete_snapshot" :: held 2.262s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:28 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-64ba9058-ba20-497e-9ab3-8497893b5602 tempest-SnapshotsActionsTest-1685438083 None] Created reservations ['32b388ee-d4cd-496b-b726-8f3a4eec43f9', 'bf26ac8c-caf1-42a0-b2ed-81dc28a4e4bd', '3d809a0f-aa22-4180-b8f5-d74310603f9f', '4ff1021f-5506-4ac0-bb21-54e30a7446d3'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:57:29 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-64ba9058-ba20-497e-9ab3-8497893b5602 tempest-SnapshotsActionsTest-1685438083 None] Delete snapshot completed successfully. Sep 04 15:57:29 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-64ba9058-ba20-497e-9ab3-8497893b5602 tempest-SnapshotsActionsTest-1685438083 None] Lock "cinder-182d7ef6-057d-44b7-b99a-f3a5e342e317-delete_snapshot" released by "delete_snapshot" :: held 2.516s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:29 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-6ab86431-ead7-4f4c-b0a0-cb214c4f5dc5 tempest-VolumesTransfersV357Test-1495644634 None] Transfer volume completed successfully. Sep 04 15:57:29 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-fb406656-6b7b-47fe-b1c7-9bd486c55436 tempest-VolumesTransfersV357Test-860755412 None] Acquiring lock "cinder-e36af25a-8205-4d8a-9400-d1eb1c43ae8e-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:29 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-fb406656-6b7b-47fe-b1c7-9bd486c55436 tempest-VolumesTransfersV357Test-860755412 None] Lock "cinder-e36af25a-8205-4d8a-9400-d1eb1c43ae8e-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:30 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-fb406656-6b7b-47fe-b1c7-9bd486c55436 tempest-VolumesTransfersV357Test-860755412 None] Acquiring lock "cinder-quobyte-e36af25a-8205-4d8a-9400-d1eb1c43ae8e" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:30 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-fb406656-6b7b-47fe-b1c7-9bd486c55436 tempest-VolumesTransfersV357Test-860755412 None] Lock "cinder-quobyte-e36af25a-8205-4d8a-9400-d1eb1c43ae8e" acquired by "delete_volume" :: waited 0.039s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:30 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef891f9a-bbf5-400b-afc9-9036d2a7b814]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-fb406656-6b7b-47fe-b1c7-9bd486c55436 tempest-VolumesTransfersV357Test-860755412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e36af25a-8205-4d8a-9400-d1eb1c43ae8e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:30 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e36af25a-8205-4d8a-9400-d1eb1c43ae8e Sep 04 15:57:30 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:30 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=129,cinder:INSERT=34,cinder:UPDATE=132,cinder:DELETE=13 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:57:30 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:UPDATE=143,cinder:SELECT=125,cinder:INSERT=39,cinder:DELETE=4 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:57:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2518d76a-2b00-416d-afc2-a2c427ad9a40 tempest-SnapshotsActionsTest-1135109523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2518d76a-2b00-416d-afc2-a2c427ad9a40 tempest-SnapshotsActionsTest-1135109523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:30 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-2518d76a-2b00-416d-afc2-a2c427ad9a40 tempest-SnapshotsActionsTest-1135109523 None] Creating offline snapshot a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a of volume a7ae0227-7503-4b7c-a4b0-50edcda84d6d {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:57:30 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-fb406656-6b7b-47fe-b1c7-9bd486c55436 tempest-VolumesTransfersV357Test-860755412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e36af25a-8205-4d8a-9400-d1eb1c43ae8e" returned: 0 in 0.531s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-fb406656-6b7b-47fe-b1c7-9bd486c55436 tempest-VolumesTransfersV357Test-860755412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e36af25a-8205-4d8a-9400-d1eb1c43ae8e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:30 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[583609b3-eb54-406e-ba9e-65669919d253]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2518d76a-2b00-416d-afc2-a2c427ad9a40 tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:30 devstack sudo[98432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e36af25a-8205-4d8a-9400-d1eb1c43ae8e Sep 04 15:57:30 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:30 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c Sep 04 15:57:30 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:31 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-fb406656-6b7b-47fe-b1c7-9bd486c55436 tempest-VolumesTransfersV357Test-860755412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e36af25a-8205-4d8a-9400-d1eb1c43ae8e" returned: 0 in 0.409s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-fb406656-6b7b-47fe-b1c7-9bd486c55436 tempest-VolumesTransfersV357Test-860755412 None] Lock "cinder-quobyte-e36af25a-8205-4d8a-9400-d1eb1c43ae8e" released by "delete_volume" :: held 1.024s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:31 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-fb406656-6b7b-47fe-b1c7-9bd486c55436 tempest-VolumesTransfersV357Test-860755412 None] Created reservations ['218c2fb0-9f6b-4c34-a276-26b895018818', 'e7ed9d6c-6321-478f-a048-761f37684e5e', '76c9e4e1-c5f1-47ff-a23c-9fa29f4b33ca', '90c0f5bf-fcbb-434e-a8e6-48af6578d718'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:57:31 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2518d76a-2b00-416d-afc2-a2c427ad9a40 tempest-SnapshotsActionsTest-1135109523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c" returned: 0 in 0.484s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:31 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-2518d76a-2b00-416d-afc2-a2c427ad9a40 tempest-SnapshotsActionsTest-1135109523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:57:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2518d76a-2b00-416d-afc2-a2c427ad9a40 tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:31 devstack sudo[98440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a 1G Sep 04 15:57:31 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-fb406656-6b7b-47fe-b1c7-9bd486c55436 tempest-VolumesTransfersV357Test-860755412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-fb406656-6b7b-47fe-b1c7-9bd486c55436 tempest-VolumesTransfersV357Test-860755412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:31 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-fb406656-6b7b-47fe-b1c7-9bd486c55436 tempest-VolumesTransfersV357Test-860755412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:57:31 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-fb406656-6b7b-47fe-b1c7-9bd486c55436 tempest-VolumesTransfersV357Test-860755412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:57:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-fb406656-6b7b-47fe-b1c7-9bd486c55436 tempest-VolumesTransfersV357Test-860755412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-fb406656-6b7b-47fe-b1c7-9bd486c55436 tempest-VolumesTransfersV357Test-860755412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:31 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:57:31 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:31 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-fb406656-6b7b-47fe-b1c7-9bd486c55436 tempest-VolumesTransfersV357Test-860755412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.313s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:31 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-fb406656-6b7b-47fe-b1c7-9bd486c55436 tempest-VolumesTransfersV357Test-860755412 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:57:31 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-fb406656-6b7b-47fe-b1c7-9bd486c55436 tempest-VolumesTransfersV357Test-860755412 None] Deleted volume successfully. Sep 04 15:57:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-fb406656-6b7b-47fe-b1c7-9bd486c55436 tempest-VolumesTransfersV357Test-860755412 None] Lock "cinder-e36af25a-8205-4d8a-9400-d1eb1c43ae8e-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:31 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2518d76a-2b00-416d-afc2-a2c427ad9a40 tempest-SnapshotsActionsTest-1135109523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a 1G" returned: 0 in 0.641s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2518d76a-2b00-416d-afc2-a2c427ad9a40 tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:31 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a Sep 04 15:57:31 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:32 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2518d76a-2b00-416d-afc2-a2c427ad9a40 tempest-SnapshotsActionsTest-1135109523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a" returned: 0 in 0.389s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:32 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-2518d76a-2b00-416d-afc2-a2c427ad9a40 tempest-SnapshotsActionsTest-1135109523 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a is being set with open permissions: ugo+rw Sep 04 15:57:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2518d76a-2b00-416d-afc2-a2c427ad9a40 tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:32 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a Sep 04 15:57:32 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:32 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2518d76a-2b00-416d-afc2-a2c427ad9a40 tempest-SnapshotsActionsTest-1135109523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a" returned: 0 in 0.323s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2518d76a-2b00-416d-afc2-a2c427ad9a40 tempest-SnapshotsActionsTest-1135109523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:32 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-2518d76a-2b00-416d-afc2-a2c427ad9a40 tempest-SnapshotsActionsTest-1135109523 None] Create snapshot completed successfully Sep 04 15:57:32 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:57:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Flow 'volume_create_manager' (b64d1758-3e0b-448d-8fa6-d44b578c0dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:57:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca0036e-2c77-46f9-b7e3-dc81ee2adcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca0036e-2c77-46f9-b7e3-dc81ee2adcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-991568537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ee1446-d5be-4f0f-a31c-38bdda5be4ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5170a582e466443ca46013897735c431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:33Z,use_quota=True,user_id='cc601916f5aa4f889fae1756cd03b4c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f55292-50cf-4066-9471-59b15d2ee010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f55292-50cf-4066-9471-59b15d2ee010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa67ed4b-4b67-4e98-8733-39c1af0dc10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa67ed4b-4b67-4e98-8733-39c1af0dc10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26ee1446-d5be-4f0f-a31c-38bdda5be4ba', 'volume_name': 'volume-26ee1446-d5be-4f0f-a31c-38bdda5be4ba', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd266b2-8571-4837-aae0-cf582a2d8e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd266b2-8571-4837-aae0-cf582a2d8e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (488494c5-4625-4865-8c47-72d9a873108d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:33 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Volume 26ee1446-d5be-4f0f-a31c-38bdda5be4ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26ee1446-d5be-4f0f-a31c-38bdda5be4ba', 'volume_size': 1} Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-991568537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ee1446-d5be-4f0f-a31c-38bdda5be4ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5170a582e466443ca46013897735c431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:33Z,use_quota=True,user_id='cc601916f5aa4f889fae1756cd03b4c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Creating volume 26ee1446-d5be-4f0f-a31c-38bdda5be4ba {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:57:33 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-26ee1446-d5be-4f0f-a31c-38bdda5be4ba 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-17a58217-b7ff-434c-9a89-9f797cce493b tempest-SnapshotsActionsTest-1685438083 None] Acquiring lock "cinder-a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-17a58217-b7ff-434c-9a89-9f797cce493b tempest-SnapshotsActionsTest-1685438083 None] Lock "cinder-a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-17a58217-b7ff-434c-9a89-9f797cce493b tempest-SnapshotsActionsTest-1685438083 None] Acquiring lock "cinder-quobyte-a7ae0227-7503-4b7c-a4b0-50edcda84d6d" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:33 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-26ee1446-d5be-4f0f-a31c-38bdda5be4ba 1073741824 Sep 04 15:57:33 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-17a58217-b7ff-434c-9a89-9f797cce493b tempest-SnapshotsActionsTest-1685438083 None] Lock "cinder-quobyte-a7ae0227-7503-4b7c-a4b0-50edcda84d6d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-17a58217-b7ff-434c-9a89-9f797cce493b tempest-SnapshotsActionsTest-1685438083 None] Acquiring lock "cinder-quobyte-a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-17a58217-b7ff-434c-9a89-9f797cce493b tempest-SnapshotsActionsTest-1685438083 None] Lock "cinder-quobyte-a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-17a58217-b7ff-434c-9a89-9f797cce493b tempest-SnapshotsActionsTest-1685438083 None] Deleting offline snapshot a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a of volume a7ae0227-7503-4b7c-a4b0-50edcda84d6d {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-17a58217-b7ff-434c-9a89-9f797cce493b tempest-SnapshotsActionsTest-1685438083 None] snapshot_file for this snap is: volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b54c546-5b6d-41d5-8489-6afba731aecf]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-17a58217-b7ff-434c-9a89-9f797cce493b tempest-SnapshotsActionsTest-1685438083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:33 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a Sep 04 15:57:33 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:33 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:33 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-17a58217-b7ff-434c-9a89-9f797cce493b tempest-SnapshotsActionsTest-1685438083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a" returned: 0 in 0.519s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-17a58217-b7ff-434c-9a89-9f797cce493b tempest-SnapshotsActionsTest-1685438083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-26ee1446-d5be-4f0f-a31c-38bdda5be4ba 1073741824" returned: 0 in 0.761s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dfb036-9054-4fe0-acc3-46494d8a5d87]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-17a58217-b7ff-434c-9a89-9f797cce493b tempest-SnapshotsActionsTest-1685438083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-26ee1446-d5be-4f0f-a31c-38bdda5be4ba {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:33 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-26ee1446-d5be-4f0f-a31c-38bdda5be4ba Sep 04 15:57:33 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:33 devstack sudo[98468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c Sep 04 15:57:33 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:34 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-26ee1446-d5be-4f0f-a31c-38bdda5be4ba" returned: 0 in 0.334s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:57:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (488494c5-4625-4865-8c47-72d9a873108d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26ee1446-d5be-4f0f-a31c-38bdda5be4ba', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf036af2-5897-44c6-bb88-918eb3ea5f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:34 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Volume volume-26ee1446-d5be-4f0f-a31c-38bdda5be4ba (26ee1446-d5be-4f0f-a31c-38bdda5be4ba): created successfully Sep 04 15:57:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf036af2-5897-44c6-bb88-918eb3ea5f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Flow 'volume_create_manager' (b64d1758-3e0b-448d-8fa6-d44b578c0dda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:57:34 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-efdb8d69-7b56-4e26-8046-5afb7eeadf69 tempest-VolumesTransfersV357Test-1293591352 None] Created volume successfully. Sep 04 15:57:34 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-17a58217-b7ff-434c-9a89-9f797cce493b tempest-SnapshotsActionsTest-1685438083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c" returned: 0 in 0.565s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-17a58217-b7ff-434c-9a89-9f797cce493b tempest-SnapshotsActionsTest-1685438083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:57:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-17a58217-b7ff-434c-9a89-9f797cce493b tempest-SnapshotsActionsTest-1685438083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:34 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a Sep 04 15:57:34 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:34 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-17a58217-b7ff-434c-9a89-9f797cce493b tempest-SnapshotsActionsTest-1685438083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a" returned: 0 in 0.503s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-17a58217-b7ff-434c-9a89-9f797cce493b tempest-SnapshotsActionsTest-1685438083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:34 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a Sep 04 15:57:34 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:35 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-17a58217-b7ff-434c-9a89-9f797cce493b tempest-SnapshotsActionsTest-1685438083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a" returned: 0 in 0.338s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-17a58217-b7ff-434c-9a89-9f797cce493b tempest-SnapshotsActionsTest-1685438083 None] Lock "cinder-quobyte-a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a" released by "_delete_snapshot" :: held 2.149s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-17a58217-b7ff-434c-9a89-9f797cce493b tempest-SnapshotsActionsTest-1685438083 None] Lock "cinder-quobyte-a7ae0227-7503-4b7c-a4b0-50edcda84d6d" released by "delete_snapshot" :: held 2.197s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:35 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-17a58217-b7ff-434c-9a89-9f797cce493b tempest-SnapshotsActionsTest-1685438083 None] Created reservations ['f4366dba-9fc8-4dad-836d-728b3521778f', '7414ec43-0c8e-448a-873b-efa27ec5a74d', '856020fb-297c-44a0-8505-f33916d543da', 'dce374ef-2c15-48ec-8822-a441b144bb44'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:57:35 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-17a58217-b7ff-434c-9a89-9f797cce493b tempest-SnapshotsActionsTest-1685438083 None] Delete snapshot completed successfully. Sep 04 15:57:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-17a58217-b7ff-434c-9a89-9f797cce493b tempest-SnapshotsActionsTest-1685438083 None] Lock "cinder-a0cb63e9-0db5-42e5-afb9-9ccd60b19f4a-delete_snapshot" released by "delete_snapshot" :: held 2.434s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f0063f8a-4910-4cfe-b133-81e98e55e0fe tempest-VolumesTransfersV357Test-860755412 None] Acquiring lock "cinder-26ee1446-d5be-4f0f-a31c-38bdda5be4ba-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f0063f8a-4910-4cfe-b133-81e98e55e0fe tempest-VolumesTransfersV357Test-860755412 None] Lock "cinder-26ee1446-d5be-4f0f-a31c-38bdda5be4ba-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f0063f8a-4910-4cfe-b133-81e98e55e0fe tempest-VolumesTransfersV357Test-860755412 None] Acquiring lock "cinder-quobyte-26ee1446-d5be-4f0f-a31c-38bdda5be4ba" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f0063f8a-4910-4cfe-b133-81e98e55e0fe tempest-VolumesTransfersV357Test-860755412 None] Lock "cinder-quobyte-26ee1446-d5be-4f0f-a31c-38bdda5be4ba" acquired by "delete_volume" :: waited 0.027s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:35 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2c649d-ba64-4331-9a09-b8700fcddc34]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f0063f8a-4910-4cfe-b133-81e98e55e0fe tempest-VolumesTransfersV357Test-860755412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-26ee1446-d5be-4f0f-a31c-38bdda5be4ba {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:35 devstack sudo[98485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-26ee1446-d5be-4f0f-a31c-38bdda5be4ba Sep 04 15:57:35 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:36 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f0063f8a-4910-4cfe-b133-81e98e55e0fe tempest-VolumesTransfersV357Test-860755412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-26ee1446-d5be-4f0f-a31c-38bdda5be4ba" returned: 0 in 0.603s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f0063f8a-4910-4cfe-b133-81e98e55e0fe tempest-VolumesTransfersV357Test-860755412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-26ee1446-d5be-4f0f-a31c-38bdda5be4ba {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:36 devstack sudo[98491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-26ee1446-d5be-4f0f-a31c-38bdda5be4ba Sep 04 15:57:36 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-703ecc65-cc0a-4304-82aa-0bd894e35ffe tempest-SnapshotsActionsTest-1135109523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-703ecc65-cc0a-4304-82aa-0bd894e35ffe tempest-SnapshotsActionsTest-1135109523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:36 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-703ecc65-cc0a-4304-82aa-0bd894e35ffe tempest-SnapshotsActionsTest-1135109523 None] Creating offline snapshot e7627f7f-e4f9-46d9-a471-2afac76ef64c of volume a7ae0227-7503-4b7c-a4b0-50edcda84d6d {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:57:36 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f0063f8a-4910-4cfe-b133-81e98e55e0fe tempest-VolumesTransfersV357Test-860755412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-26ee1446-d5be-4f0f-a31c-38bdda5be4ba" returned: 0 in 0.525s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:36 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[438623a9-a814-43c5-83c1-872b8c206ed0]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:36 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f0063f8a-4910-4cfe-b133-81e98e55e0fe tempest-VolumesTransfersV357Test-860755412 None] Lock "cinder-quobyte-26ee1446-d5be-4f0f-a31c-38bdda5be4ba" released by "delete_volume" :: held 1.209s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-703ecc65-cc0a-4304-82aa-0bd894e35ffe tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:36 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-f0063f8a-4910-4cfe-b133-81e98e55e0fe tempest-VolumesTransfersV357Test-860755412 None] Created reservations ['c8196aac-bacd-44da-b5ad-63313fc039a4', 'a929af2f-0832-41b5-b683-77371f777cb9', 'd2bd5b43-96d6-4050-a867-01088cd824ca', '94cbc412-92b3-4b5b-a674-5f93d011e32a'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:57:37 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c Sep 04 15:57:37 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f0063f8a-4910-4cfe-b133-81e98e55e0fe tempest-VolumesTransfersV357Test-860755412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f0063f8a-4910-4cfe-b133-81e98e55e0fe tempest-VolumesTransfersV357Test-860755412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:37 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f0063f8a-4910-4cfe-b133-81e98e55e0fe tempest-VolumesTransfersV357Test-860755412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:57:37 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f0063f8a-4910-4cfe-b133-81e98e55e0fe tempest-VolumesTransfersV357Test-860755412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:57:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f0063f8a-4910-4cfe-b133-81e98e55e0fe tempest-VolumesTransfersV357Test-860755412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f0063f8a-4910-4cfe-b133-81e98e55e0fe tempest-VolumesTransfersV357Test-860755412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:37 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:57:37 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:37 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-703ecc65-cc0a-4304-82aa-0bd894e35ffe tempest-SnapshotsActionsTest-1135109523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c" returned: 0 in 0.427s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:37 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-703ecc65-cc0a-4304-82aa-0bd894e35ffe tempest-SnapshotsActionsTest-1135109523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:57:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-703ecc65-cc0a-4304-82aa-0bd894e35ffe tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.e7627f7f-e4f9-46d9-a471-2afac76ef64c 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:37 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.e7627f7f-e4f9-46d9-a471-2afac76ef64c 1G Sep 04 15:57:37 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:37 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f0063f8a-4910-4cfe-b133-81e98e55e0fe tempest-VolumesTransfersV357Test-860755412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.270s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:37 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-f0063f8a-4910-4cfe-b133-81e98e55e0fe tempest-VolumesTransfersV357Test-860755412 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:57:37 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-f0063f8a-4910-4cfe-b133-81e98e55e0fe tempest-VolumesTransfersV357Test-860755412 None] Deleted volume successfully. Sep 04 15:57:37 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f0063f8a-4910-4cfe-b133-81e98e55e0fe tempest-VolumesTransfersV357Test-860755412 None] Lock "cinder-26ee1446-d5be-4f0f-a31c-38bdda5be4ba-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:37 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-703ecc65-cc0a-4304-82aa-0bd894e35ffe tempest-SnapshotsActionsTest-1135109523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.e7627f7f-e4f9-46d9-a471-2afac76ef64c 1G" returned: 0 in 0.561s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-703ecc65-cc0a-4304-82aa-0bd894e35ffe tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.e7627f7f-e4f9-46d9-a471-2afac76ef64c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:37 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.e7627f7f-e4f9-46d9-a471-2afac76ef64c Sep 04 15:57:37 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:57:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:57:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:57:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:38 devstack sudo[98517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:57:38 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:38 devstack sudo[98517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-703ecc65-cc0a-4304-82aa-0bd894e35ffe tempest-SnapshotsActionsTest-1135109523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.e7627f7f-e4f9-46d9-a471-2afac76ef64c" returned: 0 in 0.386s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:38 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-703ecc65-cc0a-4304-82aa-0bd894e35ffe tempest-SnapshotsActionsTest-1135109523 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.e7627f7f-e4f9-46d9-a471-2afac76ef64c is being set with open permissions: ugo+rw Sep 04 15:57:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-703ecc65-cc0a-4304-82aa-0bd894e35ffe tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.e7627f7f-e4f9-46d9-a471-2afac76ef64c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:38 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.e7627f7f-e4f9-46d9-a471-2afac76ef64c Sep 04 15:57:38 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:38 devstack sudo[98517]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.394s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:38 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:57:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager._thread_info {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:57:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread count: 28 {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:57:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread info: [<_MainThread(MainThread, started 138899118923904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:57:38 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-703ecc65-cc0a-4304-82aa-0bd894e35ffe tempest-SnapshotsActionsTest-1135109523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.e7627f7f-e4f9-46d9-a471-2afac76ef64c" returned: 0 in 0.436s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-703ecc65-cc0a-4304-82aa-0bd894e35ffe tempest-SnapshotsActionsTest-1135109523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.052s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:38 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-703ecc65-cc0a-4304-82aa-0bd894e35ffe tempest-SnapshotsActionsTest-1135109523 None] Create snapshot completed successfully Sep 04 15:57:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5536af8e-bada-40c5-af0b-8284d03d33fa tempest-SnapshotsActionsTest-1685438083 None] Acquiring lock "cinder-e7627f7f-e4f9-46d9-a471-2afac76ef64c-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5536af8e-bada-40c5-af0b-8284d03d33fa tempest-SnapshotsActionsTest-1685438083 None] Lock "cinder-e7627f7f-e4f9-46d9-a471-2afac76ef64c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5536af8e-bada-40c5-af0b-8284d03d33fa tempest-SnapshotsActionsTest-1685438083 None] Acquiring lock "cinder-quobyte-a7ae0227-7503-4b7c-a4b0-50edcda84d6d" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5536af8e-bada-40c5-af0b-8284d03d33fa tempest-SnapshotsActionsTest-1685438083 None] Lock "cinder-quobyte-a7ae0227-7503-4b7c-a4b0-50edcda84d6d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5536af8e-bada-40c5-af0b-8284d03d33fa tempest-SnapshotsActionsTest-1685438083 None] Acquiring lock "cinder-quobyte-e7627f7f-e4f9-46d9-a471-2afac76ef64c" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5536af8e-bada-40c5-af0b-8284d03d33fa tempest-SnapshotsActionsTest-1685438083 None] Lock "cinder-quobyte-e7627f7f-e4f9-46d9-a471-2afac76ef64c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:40 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-5536af8e-bada-40c5-af0b-8284d03d33fa tempest-SnapshotsActionsTest-1685438083 None] Deleting offline snapshot e7627f7f-e4f9-46d9-a471-2afac76ef64c of volume a7ae0227-7503-4b7c-a4b0-50edcda84d6d {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:57:40 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-5536af8e-bada-40c5-af0b-8284d03d33fa tempest-SnapshotsActionsTest-1685438083 None] snapshot_file for this snap is: volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.e7627f7f-e4f9-46d9-a471-2afac76ef64c {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:57:40 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77fdbe6-d45f-4196-a006-cf0c921ea112]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5536af8e-bada-40c5-af0b-8284d03d33fa tempest-SnapshotsActionsTest-1685438083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.e7627f7f-e4f9-46d9-a471-2afac76ef64c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:40 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.e7627f7f-e4f9-46d9-a471-2afac76ef64c Sep 04 15:57:40 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:40 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5536af8e-bada-40c5-af0b-8284d03d33fa tempest-SnapshotsActionsTest-1685438083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.e7627f7f-e4f9-46d9-a471-2afac76ef64c" returned: 0 in 0.503s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:40 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-5536af8e-bada-40c5-af0b-8284d03d33fa tempest-SnapshotsActionsTest-1685438083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:57:40 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[547ed33c-7501-4e1f-9250-082d4697111b]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5536af8e-bada-40c5-af0b-8284d03d33fa tempest-SnapshotsActionsTest-1685438083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:40 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c Sep 04 15:57:40 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:41 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5536af8e-bada-40c5-af0b-8284d03d33fa tempest-SnapshotsActionsTest-1685438083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c" returned: 0 in 0.517s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:41 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-5536af8e-bada-40c5-af0b-8284d03d33fa tempest-SnapshotsActionsTest-1685438083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:57:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5536af8e-bada-40c5-af0b-8284d03d33fa tempest-SnapshotsActionsTest-1685438083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.e7627f7f-e4f9-46d9-a471-2afac76ef64c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:41 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.e7627f7f-e4f9-46d9-a471-2afac76ef64c Sep 04 15:57:41 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:41 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5536af8e-bada-40c5-af0b-8284d03d33fa tempest-SnapshotsActionsTest-1685438083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.e7627f7f-e4f9-46d9-a471-2afac76ef64c" returned: 0 in 0.467s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5536af8e-bada-40c5-af0b-8284d03d33fa tempest-SnapshotsActionsTest-1685438083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.e7627f7f-e4f9-46d9-a471-2afac76ef64c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:41 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.e7627f7f-e4f9-46d9-a471-2afac76ef64c Sep 04 15:57:41 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:42 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5536af8e-bada-40c5-af0b-8284d03d33fa tempest-SnapshotsActionsTest-1685438083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.e7627f7f-e4f9-46d9-a471-2afac76ef64c" returned: 0 in 0.295s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:42 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5536af8e-bada-40c5-af0b-8284d03d33fa tempest-SnapshotsActionsTest-1685438083 None] Lock "cinder-quobyte-e7627f7f-e4f9-46d9-a471-2afac76ef64c" released by "_delete_snapshot" :: held 1.971s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:42 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5536af8e-bada-40c5-af0b-8284d03d33fa tempest-SnapshotsActionsTest-1685438083 None] Lock "cinder-quobyte-a7ae0227-7503-4b7c-a4b0-50edcda84d6d" released by "delete_snapshot" :: held 2.002s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:42 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-5536af8e-bada-40c5-af0b-8284d03d33fa tempest-SnapshotsActionsTest-1685438083 None] Created reservations ['29ed9fe2-ef15-47be-90eb-2d86da0cf8e7', 'edc6185e-86d0-4f51-80b6-135b33409da6', 'fa31c888-ec62-4c8f-a8b5-061abc0058f6', '27db54b6-6e7c-4164-b201-69f99c38f243'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:57:42 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-5536af8e-bada-40c5-af0b-8284d03d33fa tempest-SnapshotsActionsTest-1685438083 None] Delete snapshot completed successfully. Sep 04 15:57:42 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5536af8e-bada-40c5-af0b-8284d03d33fa tempest-SnapshotsActionsTest-1685438083 None] Lock "cinder-e7627f7f-e4f9-46d9-a471-2afac76ef64c-delete_snapshot" released by "delete_snapshot" :: held 2.194s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7d674f6d-9002-40fe-980a-0fc084a47bcf tempest-SnapshotsActionsTest-1135109523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7d674f6d-9002-40fe-980a-0fc084a47bcf tempest-SnapshotsActionsTest-1135109523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-7d674f6d-9002-40fe-980a-0fc084a47bcf tempest-SnapshotsActionsTest-1135109523 None] Creating offline snapshot aea9fc3c-2f89-4cbc-8644-3ac58b286ff5 of volume a7ae0227-7503-4b7c-a4b0-50edcda84d6d {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:57:43 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0835590-d0a8-4d22-b82e-d90a32f65ba0]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7d674f6d-9002-40fe-980a-0fc084a47bcf tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:43 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c Sep 04 15:57:43 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:44 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7d674f6d-9002-40fe-980a-0fc084a47bcf tempest-SnapshotsActionsTest-1135109523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c" returned: 0 in 0.494s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-7d674f6d-9002-40fe-980a-0fc084a47bcf tempest-SnapshotsActionsTest-1135109523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:57:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7d674f6d-9002-40fe-980a-0fc084a47bcf tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.aea9fc3c-2f89-4cbc-8644-3ac58b286ff5 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:44 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.aea9fc3c-2f89-4cbc-8644-3ac58b286ff5 1G Sep 04 15:57:44 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:44 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7d674f6d-9002-40fe-980a-0fc084a47bcf tempest-SnapshotsActionsTest-1135109523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.aea9fc3c-2f89-4cbc-8644-3ac58b286ff5 1G" returned: 0 in 0.634s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7d674f6d-9002-40fe-980a-0fc084a47bcf tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.aea9fc3c-2f89-4cbc-8644-3ac58b286ff5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:44 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.aea9fc3c-2f89-4cbc-8644-3ac58b286ff5 Sep 04 15:57:44 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:45 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7d674f6d-9002-40fe-980a-0fc084a47bcf tempest-SnapshotsActionsTest-1135109523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.aea9fc3c-2f89-4cbc-8644-3ac58b286ff5" returned: 0 in 0.639s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:45 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-7d674f6d-9002-40fe-980a-0fc084a47bcf tempest-SnapshotsActionsTest-1135109523 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.aea9fc3c-2f89-4cbc-8644-3ac58b286ff5 is being set with open permissions: ugo+rw Sep 04 15:57:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7d674f6d-9002-40fe-980a-0fc084a47bcf tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.aea9fc3c-2f89-4cbc-8644-3ac58b286ff5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:45 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.aea9fc3c-2f89-4cbc-8644-3ac58b286ff5 Sep 04 15:57:45 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:46 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7d674f6d-9002-40fe-980a-0fc084a47bcf tempest-SnapshotsActionsTest-1135109523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.aea9fc3c-2f89-4cbc-8644-3ac58b286ff5" returned: 0 in 0.734s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7d674f6d-9002-40fe-980a-0fc084a47bcf tempest-SnapshotsActionsTest-1135109523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.731s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:46 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-7d674f6d-9002-40fe-980a-0fc084a47bcf tempest-SnapshotsActionsTest-1135109523 None] Create snapshot completed successfully Sep 04 15:57:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1e7b6719-c925-470f-86f2-193e771e1b0c tempest-SnapshotsActionsTest-1685438083 None] Acquiring lock "cinder-aea9fc3c-2f89-4cbc-8644-3ac58b286ff5-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1e7b6719-c925-470f-86f2-193e771e1b0c tempest-SnapshotsActionsTest-1685438083 None] Lock "cinder-aea9fc3c-2f89-4cbc-8644-3ac58b286ff5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1e7b6719-c925-470f-86f2-193e771e1b0c tempest-SnapshotsActionsTest-1685438083 None] Acquiring lock "cinder-quobyte-a7ae0227-7503-4b7c-a4b0-50edcda84d6d" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1e7b6719-c925-470f-86f2-193e771e1b0c tempest-SnapshotsActionsTest-1685438083 None] Lock "cinder-quobyte-a7ae0227-7503-4b7c-a4b0-50edcda84d6d" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1e7b6719-c925-470f-86f2-193e771e1b0c tempest-SnapshotsActionsTest-1685438083 None] Acquiring lock "cinder-quobyte-aea9fc3c-2f89-4cbc-8644-3ac58b286ff5" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1e7b6719-c925-470f-86f2-193e771e1b0c tempest-SnapshotsActionsTest-1685438083 None] Lock "cinder-quobyte-aea9fc3c-2f89-4cbc-8644-3ac58b286ff5" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:47 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-1e7b6719-c925-470f-86f2-193e771e1b0c tempest-SnapshotsActionsTest-1685438083 None] Deleting offline snapshot aea9fc3c-2f89-4cbc-8644-3ac58b286ff5 of volume a7ae0227-7503-4b7c-a4b0-50edcda84d6d {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:57:47 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-1e7b6719-c925-470f-86f2-193e771e1b0c tempest-SnapshotsActionsTest-1685438083 None] snapshot_file for this snap is: volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.aea9fc3c-2f89-4cbc-8644-3ac58b286ff5 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:57:47 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4174724-7e9d-4981-9931-9bddb205cf32]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1e7b6719-c925-470f-86f2-193e771e1b0c tempest-SnapshotsActionsTest-1685438083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.aea9fc3c-2f89-4cbc-8644-3ac58b286ff5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:47 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.aea9fc3c-2f89-4cbc-8644-3ac58b286ff5 Sep 04 15:57:47 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:48 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1e7b6719-c925-470f-86f2-193e771e1b0c tempest-SnapshotsActionsTest-1685438083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.aea9fc3c-2f89-4cbc-8644-3ac58b286ff5" returned: 0 in 0.846s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-1e7b6719-c925-470f-86f2-193e771e1b0c tempest-SnapshotsActionsTest-1685438083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:57:48 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[97978523-7e31-453d-ad89-e5e338ec08fa]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1e7b6719-c925-470f-86f2-193e771e1b0c tempest-SnapshotsActionsTest-1685438083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:48 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c Sep 04 15:57:48 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:49 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:57:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Flow 'volume_create_manager' (070d7f45-80a0-4c82-8c69-5ca3bb996733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:57:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cbdd46d-2741-4cf0-b80c-22c1f7121a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cbdd46d-2741-4cf0-b80c-22c1f7121a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-174155592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c683ca1e-7337-463c-9aad-cbc11a5f9936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f760007a8a94335a12ba467a8378fad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:49Z,use_quota=True,user_id='20285c2abcab423a8a61ac442f6f7ac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f7153a-438d-4240-ae4c-ab123128402d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f7153a-438d-4240-ae4c-ab123128402d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57cd00ce-c7b6-4c18-adf0-429e01a163f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:49 devstack cinder-volume[87490]: DEBUG cinder.image.glance [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Creating Keystone auth plugin from conf {{(pid=87490) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 15:57:49 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1e7b6719-c925-470f-86f2-193e771e1b0c tempest-SnapshotsActionsTest-1685438083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c" returned: 0 in 1.025s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-1e7b6719-c925-470f-86f2-193e771e1b0c tempest-SnapshotsActionsTest-1685438083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:57:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1e7b6719-c925-470f-86f2-193e771e1b0c tempest-SnapshotsActionsTest-1685438083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.aea9fc3c-2f89-4cbc-8644-3ac58b286ff5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:49 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.aea9fc3c-2f89-4cbc-8644-3ac58b286ff5 Sep 04 15:57:49 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57cd00ce-c7b6-4c18-adf0-429e01a163f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c683ca1e-7337-463c-9aad-cbc11a5f9936', 'volume_name': 'volume-c683ca1e-7337-463c-9aad-cbc11a5f9936', 'volume_size': 1, 'image_id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f11b89ae18364ea089a6f8a208910da3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'created_at': datetime.datetime(2026, 9, 4, 13, 42, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 42, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5558c17-c499-44af-95fb-afb0cb03a012/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca94993f-e547-4be6-9810-3549ebf96861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca94993f-e547-4be6-9810-3549ebf96861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ebe4dd2-74ce-4476-af7f-9b72f767091e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:50 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Volume c683ca1e-7337-463c-9aad-cbc11a5f9936: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c683ca1e-7337-463c-9aad-cbc11a5f9936', 'volume_size': 1, 'image_id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f11b89ae18364ea089a6f8a208910da3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'created_at': datetime.datetime(2026, 9, 4, 13, 42, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 42, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5558c17-c499-44af-95fb-afb0cb03a012/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Trying to clone c683ca1e-7337-463c-9aad-cbc11a5f9936 from image b5558c17-c499-44af-95fb-afb0cb03a012 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}]). {{(pid=87490) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Flow 'volume_create_manager' (b34f0ccc-0cf0-4de1-8b34-7f359092ffcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7197f15-79a2-451c-90b8-d0843a8eabad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:50 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1e7b6719-c925-470f-86f2-193e771e1b0c tempest-SnapshotsActionsTest-1685438083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.aea9fc3c-2f89-4cbc-8644-3ac58b286ff5" returned: 0 in 0.995s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1e7b6719-c925-470f-86f2-193e771e1b0c tempest-SnapshotsActionsTest-1685438083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.aea9fc3c-2f89-4cbc-8644-3ac58b286ff5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:50 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.aea9fc3c-2f89-4cbc-8644-3ac58b286ff5 Sep 04 15:57:50 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7197f15-79a2-451c-90b8-d0843a8eabad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-443565471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5430ea86-a640-45dc-81f1-e668fc573c08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a9a976d6d44d17bbfdb01837ee3a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:50Z,use_quota=True,user_id='c64105a263944a91bc1166cf17d57624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1504fdb3-ee30-4cc8-9ad0-7fe40c9ec084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1504fdb3-ee30-4cc8-9ad0-7fe40c9ec084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe86e809-f822-4648-9431-24e52a01356a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe86e809-f822-4648-9431-24e52a01356a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5430ea86-a640-45dc-81f1-e668fc573c08', 'volume_name': 'volume-5430ea86-a640-45dc-81f1-e668fc573c08', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (773e3dae-efc3-4da4-9603-7c98667913f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (773e3dae-efc3-4da4-9603-7c98667913f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ab7e4c-56b9-4ec5-a525-96cf5522238c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:50 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Volume 5430ea86-a640-45dc-81f1-e668fc573c08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5430ea86-a640-45dc-81f1-e668fc573c08', 'volume_size': 1} Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-443565471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5430ea86-a640-45dc-81f1-e668fc573c08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a9a976d6d44d17bbfdb01837ee3a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:50Z,use_quota=True,user_id='c64105a263944a91bc1166cf17d57624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Creating volume 5430ea86-a640-45dc-81f1-e668fc573c08 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:57:50 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5430ea86-a640-45dc-81f1-e668fc573c08 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:50 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5430ea86-a640-45dc-81f1-e668fc573c08 1073741824 Sep 04 15:57:50 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:50 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1e7b6719-c925-470f-86f2-193e771e1b0c tempest-SnapshotsActionsTest-1685438083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.aea9fc3c-2f89-4cbc-8644-3ac58b286ff5" returned: 0 in 0.368s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1e7b6719-c925-470f-86f2-193e771e1b0c tempest-SnapshotsActionsTest-1685438083 None] Lock "cinder-quobyte-aea9fc3c-2f89-4cbc-8644-3ac58b286ff5" released by "_delete_snapshot" :: held 3.500s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1e7b6719-c925-470f-86f2-193e771e1b0c tempest-SnapshotsActionsTest-1685438083 None] Lock "cinder-quobyte-a7ae0227-7503-4b7c-a4b0-50edcda84d6d" released by "delete_snapshot" :: held 3.569s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_t6gn_ohodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 15:57:50 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Image download 20.69 MB at 20.69 MB/s Sep 04 15:57:50 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-1e7b6719-c925-470f-86f2-193e771e1b0c tempest-SnapshotsActionsTest-1685438083 None] Created reservations ['5ae8e1b3-b12b-4ced-84d5-57ba95c95a2c', 'b590ab1f-e1c9-4831-9e61-baa4785caa37', '7ac013b5-76c8-469f-bd7c-423a30971b20', '3d4741db-af83-4d13-bb48-c5621ee90ab1'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:57:51 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d894bea-f214-46a6-b3e4-fb4367a15c72]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_t6gn_ohodevstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:51 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-1e7b6719-c925-470f-86f2-193e771e1b0c tempest-SnapshotsActionsTest-1685438083 None] Delete snapshot completed successfully. Sep 04 15:57:51 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1e7b6719-c925-470f-86f2-193e771e1b0c tempest-SnapshotsActionsTest-1685438083 None] Lock "cinder-aea9fc3c-2f89-4cbc-8644-3ac58b286ff5-delete_snapshot" released by "delete_snapshot" :: held 3.992s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:51 devstack sudo[98681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_t6gn_ohodevstack@QuobyteHD Sep 04 15:57:51 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:51 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5430ea86-a640-45dc-81f1-e668fc573c08 1073741824" returned: 0 in 0.836s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5430ea86-a640-45dc-81f1-e668fc573c08 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:51 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5430ea86-a640-45dc-81f1-e668fc573c08 Sep 04 15:57:51 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:51 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_t6gn_ohodevstack@QuobyteHD" returned: 0 in 0.501s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:51 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Temporary image b5558c17-c499-44af-95fb-afb0cb03a012 is fetched for user 20285c2abcab423a8a61ac442f6f7ac5. {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 15:57:51 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d0ecd9-b953-427a-9ec0-f3a001f004ee]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_t6gn_ohodevstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:51 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5430ea86-a640-45dc-81f1-e668fc573c08" returned: 0 in 0.427s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:51 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:57:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ab7e4c-56b9-4ec5-a525-96cf5522238c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5430ea86-a640-45dc-81f1-e668fc573c08', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1ef0bac-4164-4cc1-a537-c16031b085d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:51 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Volume volume-5430ea86-a640-45dc-81f1-e668fc573c08 (5430ea86-a640-45dc-81f1-e668fc573c08): created successfully Sep 04 15:57:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1ef0bac-4164-4cc1-a537-c16031b085d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Flow 'volume_create_manager' (b34f0ccc-0cf0-4de1-8b34-7f359092ffcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:57:51 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-e6c3132d-5571-4343-a2ee-90ef15592253 tempest-VolumesActionsTest-524639293 None] Created volume successfully. Sep 04 15:57:51 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_t6gn_ohodevstack@QuobyteHD Sep 04 15:57:51 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cfaf8887-ee27-4a81-afa3-c2f2801cdb91 tempest-VolumesActionsTest-524639293 None] Acquiring lock "cinder-5430ea86-a640-45dc-81f1-e668fc573c08" by "attach_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cfaf8887-ee27-4a81-afa3-c2f2801cdb91 tempest-VolumesActionsTest-524639293 None] Lock "cinder-5430ea86-a640-45dc-81f1-e668fc573c08" acquired by "attach_volume" :: waited 0.047s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:52 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_t6gn_ohodevstack@QuobyteHD" returned: 0 in 0.721s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:52 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-174155592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c683ca1e-7337-463c-9aad-cbc11a5f9936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f760007a8a94335a12ba467a8378fad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:49Z,use_quota=True,user_id='20285c2abcab423a8a61ac442f6f7ac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:57:52 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Creating volume c683ca1e-7337-463c-9aad-cbc11a5f9936 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:57:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:52 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:57:52 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:57:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:52 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:57:52 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:57:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c683ca1e-7337-463c-9aad-cbc11a5f9936 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4ac215e8-c8ca-4773-99d5-c451518ce688 tempest-SnapshotsActionsTest-1135109523 None] Acquiring lock "cinder-cfa1489d-a666-4efb-8564-8cf1f69e1a9c-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:52 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c683ca1e-7337-463c-9aad-cbc11a5f9936 1073741824 Sep 04 15:57:52 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4ac215e8-c8ca-4773-99d5-c451518ce688 tempest-SnapshotsActionsTest-1135109523 None] Lock "cinder-cfa1489d-a666-4efb-8564-8cf1f69e1a9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4ac215e8-c8ca-4773-99d5-c451518ce688 tempest-SnapshotsActionsTest-1135109523 None] Acquiring lock "cinder-quobyte-a7ae0227-7503-4b7c-a4b0-50edcda84d6d" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4ac215e8-c8ca-4773-99d5-c451518ce688 tempest-SnapshotsActionsTest-1135109523 None] Lock "cinder-quobyte-a7ae0227-7503-4b7c-a4b0-50edcda84d6d" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4ac215e8-c8ca-4773-99d5-c451518ce688 tempest-SnapshotsActionsTest-1135109523 None] Acquiring lock "cinder-quobyte-cfa1489d-a666-4efb-8564-8cf1f69e1a9c" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:52 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-cfaf8887-ee27-4a81-afa3-c2f2801cdb91 tempest-VolumesActionsTest-524639293 None] Attaching volume 5430ea86-a640-45dc-81f1-e668fc573c08 to instance e93478df-7847-43fe-91fb-949ade0561a1 at mountpoint /dev/vdb on host None. Sep 04 15:57:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4ac215e8-c8ca-4773-99d5-c451518ce688 tempest-SnapshotsActionsTest-1135109523 None] Lock "cinder-quobyte-cfa1489d-a666-4efb-8564-8cf1f69e1a9c" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:52 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-4ac215e8-c8ca-4773-99d5-c451518ce688 tempest-SnapshotsActionsTest-1135109523 None] Deleting offline snapshot cfa1489d-a666-4efb-8564-8cf1f69e1a9c of volume a7ae0227-7503-4b7c-a4b0-50edcda84d6d {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:57:52 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-4ac215e8-c8ca-4773-99d5-c451518ce688 tempest-SnapshotsActionsTest-1135109523 None] snapshot_file for this snap is: volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:57:52 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e6b181-1a51-48b7-b872-5b2b0d89fc62]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ac215e8-c8ca-4773-99d5-c451518ce688 tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:52 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-cfaf8887-ee27-4a81-afa3-c2f2801cdb91 tempest-VolumesActionsTest-524639293 None] Attach volume completed successfully. Sep 04 15:57:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cfaf8887-ee27-4a81-afa3-c2f2801cdb91 tempest-VolumesActionsTest-524639293 None] Lock "cinder-5430ea86-a640-45dc-81f1-e668fc573c08" released by "attach_volume" :: held 0.344s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:52 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c Sep 04 15:57:52 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:53 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ac215e8-c8ca-4773-99d5-c451518ce688 tempest-SnapshotsActionsTest-1135109523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c" returned: 0 in 0.505s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-4ac215e8-c8ca-4773-99d5-c451518ce688 tempest-SnapshotsActionsTest-1135109523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:57:53 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9cd05b-1726-4908-9202-116c6b122055]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ac215e8-c8ca-4773-99d5-c451518ce688 tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:53 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c683ca1e-7337-463c-9aad-cbc11a5f9936 1073741824" returned: 0 in 0.821s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c683ca1e-7337-463c-9aad-cbc11a5f9936 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:53 devstack sudo[98710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c683ca1e-7337-463c-9aad-cbc11a5f9936 Sep 04 15:57:53 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:53 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d Sep 04 15:57:53 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:53 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c683ca1e-7337-463c-9aad-cbc11a5f9936" returned: 0 in 0.360s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:57:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:53 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Attempting download of b5558c17-c499-44af-95fb-afb0cb03a012 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}])) to volume c683ca1e-7337-463c-9aad-cbc11a5f9936. {{(pid=87490) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 15:57:53 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ac215e8-c8ca-4773-99d5-c451518ce688 tempest-SnapshotsActionsTest-1135109523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d" returned: 0 in 0.591s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ac215e8-c8ca-4773-99d5-c451518ce688 tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:53 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c Sep 04 15:57:53 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:53 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa94736-e099-430b-9b4e-c7ff37ed7bb0]: (4, 'raw') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_r84_g23f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:54 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-b9a06021-946f-4bcb-ab70-458bfcf0fd0f tempest-VolumesActionsTest-626533718 None] Terminate volume connection completed successfully. Sep 04 15:57:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b9a06021-946f-4bcb-ab70-458bfcf0fd0f tempest-VolumesActionsTest-626533718 None] Acquiring lock "cinder-5430ea86-a640-45dc-81f1-e668fc573c08-detach_volume" by "detach_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b9a06021-946f-4bcb-ab70-458bfcf0fd0f tempest-VolumesActionsTest-626533718 None] Lock "cinder-5430ea86-a640-45dc-81f1-e668fc573c08-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:54 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_r84_g23f Sep 04 15:57:54 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:54 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-b9a06021-946f-4bcb-ab70-458bfcf0fd0f tempest-VolumesActionsTest-626533718 None] Detaching volume 5430ea86-a640-45dc-81f1-e668fc573c08 from instance e93478df-7847-43fe-91fb-949ade0561a1. Sep 04 15:57:54 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ac215e8-c8ca-4773-99d5-c451518ce688 tempest-SnapshotsActionsTest-1135109523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c" returned: 0 in 0.443s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ac215e8-c8ca-4773-99d5-c451518ce688 tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:54 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-b9a06021-946f-4bcb-ab70-458bfcf0fd0f tempest-VolumesActionsTest-626533718 None] Detach volume completed successfully. Sep 04 15:57:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b9a06021-946f-4bcb-ab70-458bfcf0fd0f tempest-VolumesActionsTest-626533718 None] Lock "cinder-5430ea86-a640-45dc-81f1-e668fc573c08-detach_volume" released by "detach_volume" :: held 0.152s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:54 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c Sep 04 15:57:54 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:54 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_r84_g23f" returned: 0 in 0.618s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_r84_g23f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b89928ef-de24-4d8d-bf5c-2f7d1324be8f tempest-VolumesActionsTest-524639293 None] Acquiring lock "cinder-5430ea86-a640-45dc-81f1-e668fc573c08-detach_volume" by "detach_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b89928ef-de24-4d8d-bf5c-2f7d1324be8f tempest-VolumesActionsTest-524639293 None] Lock "cinder-5430ea86-a640-45dc-81f1-e668fc573c08-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:54 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-b89928ef-de24-4d8d-bf5c-2f7d1324be8f tempest-VolumesActionsTest-524639293 None] Volume detach called, but volume not attached. Sep 04 15:57:54 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ac215e8-c8ca-4773-99d5-c451518ce688 tempest-SnapshotsActionsTest-1135109523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d.cfa1489d-a666-4efb-8564-8cf1f69e1a9c" returned: 0 in 0.449s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b89928ef-de24-4d8d-bf5c-2f7d1324be8f tempest-VolumesActionsTest-524639293 None] Lock "cinder-5430ea86-a640-45dc-81f1-e668fc573c08-detach_volume" released by "detach_volume" :: held 0.046s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:54 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_r84_g23f Sep 04 15:57:54 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4ac215e8-c8ca-4773-99d5-c451518ce688 tempest-SnapshotsActionsTest-1135109523 None] Lock "cinder-quobyte-cfa1489d-a666-4efb-8564-8cf1f69e1a9c" released by "_delete_snapshot" :: held 2.186s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4ac215e8-c8ca-4773-99d5-c451518ce688 tempest-SnapshotsActionsTest-1135109523 None] Lock "cinder-quobyte-a7ae0227-7503-4b7c-a4b0-50edcda84d6d" released by "delete_snapshot" :: held 2.231s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:54 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-4ac215e8-c8ca-4773-99d5-c451518ce688 tempest-SnapshotsActionsTest-1135109523 None] Created reservations ['13beb377-4f1d-414e-81fb-e306f14af192', '1b06644c-2338-443d-9363-9630f3934f51', 'bb38720b-00ec-401e-802b-475f7cd166cf', 'fab5a852-9a86-4a46-9f1c-d4578ec7e27f'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:57:55 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-4ac215e8-c8ca-4773-99d5-c451518ce688 tempest-SnapshotsActionsTest-1135109523 None] Delete snapshot completed successfully. Sep 04 15:57:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4ac215e8-c8ca-4773-99d5-c451518ce688 tempest-SnapshotsActionsTest-1135109523 None] Lock "cinder-cfa1489d-a666-4efb-8564-8cf1f69e1a9c-delete_snapshot" released by "delete_snapshot" :: held 2.517s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b319e29f-d1b2-478d-8c5a-d1bca281992b tempest-VolumesActionsTest-524639293 None] Acquiring lock "cinder-5430ea86-a640-45dc-81f1-e668fc573c08-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:55 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_r84_g23f" returned: 1 in 0.662s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_r84_g23f' failed. Not Retrying. {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:57:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b319e29f-d1b2-478d-8c5a-d1bca281992b tempest-VolumesActionsTest-524639293 None] Lock "cinder-5430ea86-a640-45dc-81f1-e668fc573c08-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:55 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acd416c-776c-4a24-8cbe-3292a24ae169]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_t6gn_ohodevstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b319e29f-d1b2-478d-8c5a-d1bca281992b tempest-VolumesActionsTest-524639293 None] Acquiring lock "cinder-quobyte-5430ea86-a640-45dc-81f1-e668fc573c08" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b319e29f-d1b2-478d-8c5a-d1bca281992b tempest-VolumesActionsTest-524639293 None] Lock "cinder-quobyte-5430ea86-a640-45dc-81f1-e668fc573c08" acquired by "delete_volume" :: waited 0.035s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:55 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c056ba-45f8-44d4-9a75-c718ef42862a]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b319e29f-d1b2-478d-8c5a-d1bca281992b tempest-VolumesActionsTest-524639293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5430ea86-a640-45dc-81f1-e668fc573c08 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:55 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_t6gn_ohodevstack@QuobyteHD Sep 04 15:57:55 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:55 devstack sudo[98735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5430ea86-a640-45dc-81f1-e668fc573c08 Sep 04 15:57:55 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:55 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_t6gn_ohodevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:55 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] b5558c17-c499-44af-95fb-afb0cb03a012 was qcow2, converting to qcow2 {{(pid=87490) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 15:57:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_t6gn_ohodevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c683ca1e-7337-463c-9aad-cbc11a5f9936 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:55 devstack sudo[98741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_t6gn_ohodevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c683ca1e-7337-463c-9aad-cbc11a5f9936 Sep 04 15:57:55 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:55 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-04aa843d-abf1-49af-8c18-f33e31394dd8 tempest-SnapshotsActionsTest-1135109523 None] Acquiring lock "cinder-a7ae0227-7503-4b7c-a4b0-50edcda84d6d-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b319e29f-d1b2-478d-8c5a-d1bca281992b tempest-VolumesActionsTest-524639293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5430ea86-a640-45dc-81f1-e668fc573c08" returned: 0 in 0.691s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b319e29f-d1b2-478d-8c5a-d1bca281992b tempest-VolumesActionsTest-524639293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5430ea86-a640-45dc-81f1-e668fc573c08 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-04aa843d-abf1-49af-8c18-f33e31394dd8 tempest-SnapshotsActionsTest-1135109523 None] Lock "cinder-a7ae0227-7503-4b7c-a4b0-50edcda84d6d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:56 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5430ea86-a640-45dc-81f1-e668fc573c08 Sep 04 15:57:56 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-04aa843d-abf1-49af-8c18-f33e31394dd8 tempest-SnapshotsActionsTest-1135109523 None] Acquiring lock "cinder-quobyte-a7ae0227-7503-4b7c-a4b0-50edcda84d6d" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:57:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-04aa843d-abf1-49af-8c18-f33e31394dd8 tempest-SnapshotsActionsTest-1135109523 None] Lock "cinder-quobyte-a7ae0227-7503-4b7c-a4b0-50edcda84d6d" acquired by "delete_volume" :: waited 0.030s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:57:56 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee2a750-ff9d-4e72-877e-29fe6fa83d0b]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:57:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-04aa843d-abf1-49af-8c18-f33e31394dd8 tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:56 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d Sep 04 15:57:56 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:56 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b319e29f-d1b2-478d-8c5a-d1bca281992b tempest-VolumesActionsTest-524639293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5430ea86-a640-45dc-81f1-e668fc573c08" returned: 0 in 0.442s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b319e29f-d1b2-478d-8c5a-d1bca281992b tempest-VolumesActionsTest-524639293 None] Lock "cinder-quobyte-5430ea86-a640-45dc-81f1-e668fc573c08" released by "delete_volume" :: held 1.192s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:56 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-b319e29f-d1b2-478d-8c5a-d1bca281992b tempest-VolumesActionsTest-524639293 None] Created reservations ['f452056a-a0fb-417e-bbad-70d864a96fd4', '76efd8fd-765e-47eb-bbdb-e1c6a73f7294', 'efafb85b-6681-47bb-9305-f0e53bb6fd97', 'aa6d16f2-9ca9-4260-89bf-063b50db2e47'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:57:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b319e29f-d1b2-478d-8c5a-d1bca281992b tempest-VolumesActionsTest-524639293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b319e29f-d1b2-478d-8c5a-d1bca281992b tempest-VolumesActionsTest-524639293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b319e29f-d1b2-478d-8c5a-d1bca281992b tempest-VolumesActionsTest-524639293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:57:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b319e29f-d1b2-478d-8c5a-d1bca281992b tempest-VolumesActionsTest-524639293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:57:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b319e29f-d1b2-478d-8c5a-d1bca281992b tempest-VolumesActionsTest-524639293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b319e29f-d1b2-478d-8c5a-d1bca281992b tempest-VolumesActionsTest-524639293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:56 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:57:56 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:56 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-04aa843d-abf1-49af-8c18-f33e31394dd8 tempest-SnapshotsActionsTest-1135109523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d" returned: 0 in 0.636s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-04aa843d-abf1-49af-8c18-f33e31394dd8 tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:56 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d Sep 04 15:57:56 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:57 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b319e29f-d1b2-478d-8c5a-d1bca281992b tempest-VolumesActionsTest-524639293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.536s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:57 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-b319e29f-d1b2-478d-8c5a-d1bca281992b tempest-VolumesActionsTest-524639293 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:57:57 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-b319e29f-d1b2-478d-8c5a-d1bca281992b tempest-VolumesActionsTest-524639293 None] Deleted volume successfully. Sep 04 15:57:57 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b319e29f-d1b2-478d-8c5a-d1bca281992b tempest-VolumesActionsTest-524639293 None] Lock "cinder-5430ea86-a640-45dc-81f1-e668fc573c08-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-04aa843d-abf1-49af-8c18-f33e31394dd8 tempest-SnapshotsActionsTest-1135109523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a7ae0227-7503-4b7c-a4b0-50edcda84d6d" returned: 0 in 0.456s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-04aa843d-abf1-49af-8c18-f33e31394dd8 tempest-SnapshotsActionsTest-1135109523 None] Lock "cinder-quobyte-a7ae0227-7503-4b7c-a4b0-50edcda84d6d" released by "delete_volume" :: held 1.183s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:57 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-04aa843d-abf1-49af-8c18-f33e31394dd8 tempest-SnapshotsActionsTest-1135109523 None] Created reservations ['e3bb11ab-92a1-4959-bc15-b717ce1a6b53', '10efe8cd-1fe5-4fd0-ac3b-581eaee7d510', '36f50e07-b9b8-41c1-af5e-8e2ddacd0b1c', '7c26523c-c70d-438a-991b-8c38fc911152'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:57:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-04aa843d-abf1-49af-8c18-f33e31394dd8 tempest-SnapshotsActionsTest-1135109523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:57:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-04aa843d-abf1-49af-8c18-f33e31394dd8 tempest-SnapshotsActionsTest-1135109523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:57:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-04aa843d-abf1-49af-8c18-f33e31394dd8 tempest-SnapshotsActionsTest-1135109523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:57:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-04aa843d-abf1-49af-8c18-f33e31394dd8 tempest-SnapshotsActionsTest-1135109523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:57:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-04aa843d-abf1-49af-8c18-f33e31394dd8 tempest-SnapshotsActionsTest-1135109523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:57:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-04aa843d-abf1-49af-8c18-f33e31394dd8 tempest-SnapshotsActionsTest-1135109523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:57 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:57:57 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:58 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-04aa843d-abf1-49af-8c18-f33e31394dd8 tempest-SnapshotsActionsTest-1135109523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.502s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:58 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-04aa843d-abf1-49af-8c18-f33e31394dd8 tempest-SnapshotsActionsTest-1135109523 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:57:58 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-04aa843d-abf1-49af-8c18-f33e31394dd8 tempest-SnapshotsActionsTest-1135109523 None] Deleted volume successfully. Sep 04 15:57:58 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-04aa843d-abf1-49af-8c18-f33e31394dd8 tempest-SnapshotsActionsTest-1135109523 None] Lock "cinder-a7ae0227-7503-4b7c-a4b0-50edcda84d6d-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:57:58 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_t6gn_ohodevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c683ca1e-7337-463c-9aad-cbc11a5f9936" returned: 0 in 3.076s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:58 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_t6gn_ohodevstack@QuobyteHD, size 112.00 MB, duration 3.08 sec, destination /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c683ca1e-7337-463c-9aad-cbc11a5f9936 {{(pid=87490) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 15:57:58 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Converted 112.00 MB image at 36.37 MB/s Sep 04 15:57:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c683ca1e-7337-463c-9aad-cbc11a5f9936 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:57:58 devstack sudo[98792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c683ca1e-7337-463c-9aad-cbc11a5f9936 1G Sep 04 15:57:58 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:57:59 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root Sep 04 15:57:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c683ca1e-7337-463c-9aad-cbc11a5f9936 1G" returned: 0 in 0.680s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:57:59 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Downloaded image b5558c17-c499-44af-95fb-afb0cb03a012 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}])) to volume c683ca1e-7337-463c-9aad-cbc11a5f9936 successfully. {{(pid=87490) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 15:57:59 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Temporary image b5558c17-c499-44af-95fb-afb0cb03a012 for user 20285c2abcab423a8a61ac442f6f7ac5 is deleted. {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 15:57:59 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Marking volume c683ca1e-7337-463c-9aad-cbc11a5f9936 as bootable. {{(pid=87490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 15:57:59 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Copying metadata from image b5558c17-c499-44af-95fb-afb0cb03a012 to c683ca1e-7337-463c-9aad-cbc11a5f9936. {{(pid=87490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 15:57:59 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Creating volume glance metadata for volume c683ca1e-7337-463c-9aad-cbc11a5f9936 backed by image b5558c17-c499-44af-95fb-afb0cb03a012 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87490) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 15:57:59 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:57:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Flow 'volume_create_manager' (629f9cbf-dcce-4706-9320-1ef0b40c57e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:57:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc21cba2-7a48-45bb-be0b-420eaefaf069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc21cba2-7a48-45bb-be0b-420eaefaf069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f8855a-0cf8-4711-bbe9-4826f972f6ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13174935add48d69e85a2edd4261bc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:59Z,use_quota=True,user_id='b893e74d17034c179891e21221e47d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3b7cb2b-7f72-4273-a8fa-29203ef3692b),volume_type_id=e3b7cb2b-7f72-4273-a8fa-29203ef3692b)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b1ff850-6cee-43f3-a039-76f8e380d76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b1ff850-6cee-43f3-a039-76f8e380d76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64fb0451-cad1-49b7-8175-9376264e14b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:59 devstack cinder-volume[87490]: DEBUG cinder.image.glance [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Creating Keystone auth plugin from conf {{(pid=87490) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 15:57:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ebe4dd2-74ce-4476-af7f-9b72f767091e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c683ca1e-7337-463c-9aad-cbc11a5f9936', 'volume_size': 1, 'image_id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f11b89ae18364ea089a6f8a208910da3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'created_at': datetime.datetime(2026, 9, 4, 13, 42, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 42, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5558c17-c499-44af-95fb-afb0cb03a012/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f41df6-479b-47b4-a2b5-7cee19cfde32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:57:59 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Volume volume-c683ca1e-7337-463c-9aad-cbc11a5f9936 (c683ca1e-7337-463c-9aad-cbc11a5f9936): created successfully Sep 04 15:57:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f41df6-479b-47b4-a2b5-7cee19cfde32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:57:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Flow 'volume_create_manager' (070d7f45-80a0-4c82-8c69-5ca3bb996733) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:57:59 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-3a928454-20f0-473d-8f9f-9e5eb85e0835 tempest-VolumesExtendTest-1035852545 None] Created volume successfully. Sep 04 15:58:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64fb0451-cad1-49b7-8175-9376264e14b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '45f8855a-0cf8-4711-bbe9-4826f972f6ce', 'volume_name': 'volume-45f8855a-0cf8-4711-bbe9-4826f972f6ce', 'volume_size': 1, 'image_id': '45f30594-eb99-4489-8426-17288dc4314b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45f30594-eb99-4489-8426-17288dc4314b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2b02766318b6a587f86e83f7d10587ef', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c13174935add48d69e85a2edd4261bc7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e843ba7f2c2af836fee6b3c12ab70bf7a199795347871dc3269cdd95b5792b5da53490da41c98981c572afe6a4d966fa211cf7b6c54e85f5c555db95e84583d2', 'id': '45f30594-eb99-4489-8426-17288dc4314b', 'created_at': datetime.datetime(2026, 9, 4, 13, 57, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 57, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45f30594-eb99-4489-8426-17288dc4314b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef6554e-c763-449f-ae2a-68f8228f79e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef6554e-c763-449f-ae2a-68f8228f79e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e909ed9b-f797-4ffc-9218-68e5d1a246ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:00 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Volume 45f8855a-0cf8-4711-bbe9-4826f972f6ce: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-45f8855a-0cf8-4711-bbe9-4826f972f6ce', 'volume_size': 1, 'image_id': '45f30594-eb99-4489-8426-17288dc4314b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45f30594-eb99-4489-8426-17288dc4314b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2b02766318b6a587f86e83f7d10587ef', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c13174935add48d69e85a2edd4261bc7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e843ba7f2c2af836fee6b3c12ab70bf7a199795347871dc3269cdd95b5792b5da53490da41c98981c572afe6a4d966fa211cf7b6c54e85f5c555db95e84583d2', 'id': '45f30594-eb99-4489-8426-17288dc4314b', 'created_at': datetime.datetime(2026, 9, 4, 13, 57, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 57, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45f30594-eb99-4489-8426-17288dc4314b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 04 15:58:00 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Trying to clone 45f8855a-0cf8-4711-bbe9-4826f972f6ce from image 45f30594-eb99-4489-8426-17288dc4314b at location (None, [{'url': 'file:///opt/stack/data/glance/images/45f30594-eb99-4489-8426-17288dc4314b', 'metadata': {}}]). {{(pid=87490) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 15:58:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-12ffd199-4433-4b9c-8b15-83ad8f71d250 tempest-VolumesExtendTest-1035852545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-12ffd199-4433-4b9c-8b15-83ad8f71d250 tempest-VolumesExtendTest-1035852545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:00 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[187a1092-238f-4f39-9256-18cfc9a81772]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-12ffd199-4433-4b9c-8b15-83ad8f71d250 tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c683ca1e-7337-463c-9aad-cbc11a5f9936 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:00 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_45f30594-eb99-4489-8426-17288dc4314b_punnu155devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 15:58:00 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Image download 0.00 MB at 0.00 MB/s Sep 04 15:58:00 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[22019837-ceb2-4b9f-bcf4-cab1093953b2]: (4, 'raw') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45f30594-eb99-4489-8426-17288dc4314b_punnu155devstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:00 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c683ca1e-7337-463c-9aad-cbc11a5f9936 Sep 04 15:58:00 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:00 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45f30594-eb99-4489-8426-17288dc4314b_punnu155devstack@QuobyteHD Sep 04 15:58:00 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:00 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-12ffd199-4433-4b9c-8b15-83ad8f71d250 tempest-VolumesExtendTest-1035852545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c683ca1e-7337-463c-9aad-cbc11a5f9936" returned: 0 in 0.485s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-12ffd199-4433-4b9c-8b15-83ad8f71d250 tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c683ca1e-7337-463c-9aad-cbc11a5f9936 2G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:01 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45f30594-eb99-4489-8426-17288dc4314b_punnu155devstack@QuobyteHD" returned: 0 in 0.549s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45f30594-eb99-4489-8426-17288dc4314b_punnu155devstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-12ffd199-4433-4b9c-8b15-83ad8f71d250 tempest-VolumesExtendTest-1035852545 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c683ca1e-7337-463c-9aad-cbc11a5f9936 2G" returned: 0 in 0.196s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-12ffd199-4433-4b9c-8b15-83ad8f71d250 tempest-VolumesExtendTest-1035852545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.724s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:01 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-12ffd199-4433-4b9c-8b15-83ad8f71d250 tempest-VolumesExtendTest-1035852545 None] Extend volume completed successfully. Sep 04 15:58:01 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45f30594-eb99-4489-8426-17288dc4314b_punnu155devstack@QuobyteHD Sep 04 15:58:01 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:01 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45f30594-eb99-4489-8426-17288dc4314b_punnu155devstack@QuobyteHD" returned: 1 in 0.407s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45f30594-eb99-4489-8426-17288dc4314b_punnu155devstack@QuobyteHD' failed. Not Retrying. {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:58:01 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Temporary image 45f30594-eb99-4489-8426-17288dc4314b is fetched for user b893e74d17034c179891e21221e47d90. {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 15:58:01 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[855f442f-c5a7-4df1-9171-692820e38ebd]: (4, 'raw') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45f30594-eb99-4489-8426-17288dc4314b_punnu155devstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:01 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45f30594-eb99-4489-8426-17288dc4314b_punnu155devstack@QuobyteHD Sep 04 15:58:01 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d86dc824-e143-4040-b171-2df702e553c8 tempest-VolumesExtendTest-1035852545 None] Acquiring lock "cinder-c683ca1e-7337-463c-9aad-cbc11a5f9936-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d86dc824-e143-4040-b171-2df702e553c8 tempest-VolumesExtendTest-1035852545 None] Lock "cinder-c683ca1e-7337-463c-9aad-cbc11a5f9936-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d86dc824-e143-4040-b171-2df702e553c8 tempest-VolumesExtendTest-1035852545 None] Acquiring lock "cinder-quobyte-c683ca1e-7337-463c-9aad-cbc11a5f9936" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d86dc824-e143-4040-b171-2df702e553c8 tempest-VolumesExtendTest-1035852545 None] Lock "cinder-quobyte-c683ca1e-7337-463c-9aad-cbc11a5f9936" acquired by "delete_volume" :: waited 0.028s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:01 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd35585-d35c-42b9-a14f-829bb9a925ea]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d86dc824-e143-4040-b171-2df702e553c8 tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c683ca1e-7337-463c-9aad-cbc11a5f9936 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:02 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45f30594-eb99-4489-8426-17288dc4314b_punnu155devstack@QuobyteHD" returned: 0 in 0.445s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45f30594-eb99-4489-8426-17288dc4314b_punnu155devstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:02 devstack sudo[98819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c683ca1e-7337-463c-9aad-cbc11a5f9936 Sep 04 15:58:02 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:02 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45f30594-eb99-4489-8426-17288dc4314b_punnu155devstack@QuobyteHD Sep 04 15:58:02 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:02 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45f30594-eb99-4489-8426-17288dc4314b_punnu155devstack@QuobyteHD" returned: 1 in 0.383s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45f30594-eb99-4489-8426-17288dc4314b_punnu155devstack@QuobyteHD' failed. Not Retrying. {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f8855a-0cf8-4711-bbe9-4826f972f6ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13174935add48d69e85a2edd4261bc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:57:59Z,use_quota=True,user_id='b893e74d17034c179891e21221e47d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3b7cb2b-7f72-4273-a8fa-29203ef3692b),volume_type_id=e3b7cb2b-7f72-4273-a8fa-29203ef3692b)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Creating volume 45f8855a-0cf8-4711-bbe9-4826f972f6ce {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:58:02 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-45f8855a-0cf8-4711-bbe9-4826f972f6ce 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:02 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-45f8855a-0cf8-4711-bbe9-4826f972f6ce 1073741824 Sep 04 15:58:02 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:02 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d86dc824-e143-4040-b171-2df702e553c8 tempest-VolumesExtendTest-1035852545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c683ca1e-7337-463c-9aad-cbc11a5f9936" returned: 0 in 0.596s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d86dc824-e143-4040-b171-2df702e553c8 tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c683ca1e-7337-463c-9aad-cbc11a5f9936 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:02 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c683ca1e-7337-463c-9aad-cbc11a5f9936 Sep 04 15:58:02 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Flow 'volume_create_manager' (1c8e1ed4-1382-41fa-9a14-1918846e49f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b3ab2d7-2b44-428d-a3f8-f0c6e77d68d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b3ab2d7-2b44-428d-a3f8-f0c6e77d68d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-897562207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baedaa56-0ea2-4bb5-b5c6-da308406a9f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a9a976d6d44d17bbfdb01837ee3a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:03Z,use_quota=True,user_id='c64105a263944a91bc1166cf17d57624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e36e68-e381-4c53-aa74-48210e9be791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e36e68-e381-4c53-aa74-48210e9be791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:02 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d140daa-fe89-4d79-8d9f-98165efc8305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d140daa-fe89-4d79-8d9f-98165efc8305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baedaa56-0ea2-4bb5-b5c6-da308406a9f5', 'volume_name': 'volume-baedaa56-0ea2-4bb5-b5c6-da308406a9f5', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb08c1ed-43a8-4213-aff3-62446e90b89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb08c1ed-43a8-4213-aff3-62446e90b89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be1a8cdf-2a39-49e8-82ca-80fc7f29c0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:02 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Volume baedaa56-0ea2-4bb5-b5c6-da308406a9f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baedaa56-0ea2-4bb5-b5c6-da308406a9f5', 'volume_size': 1} Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d86dc824-e143-4040-b171-2df702e553c8 tempest-VolumesExtendTest-1035852545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c683ca1e-7337-463c-9aad-cbc11a5f9936" returned: 0 in 0.381s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:02 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d86dc824-e143-4040-b171-2df702e553c8 tempest-VolumesExtendTest-1035852545 None] Lock "cinder-quobyte-c683ca1e-7337-463c-9aad-cbc11a5f9936" released by "delete_volume" :: held 1.026s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-d86dc824-e143-4040-b171-2df702e553c8 tempest-VolumesExtendTest-1035852545 None] Created reservations ['bbfc44e7-f09b-496f-8c30-d62f0a81c669', '0ede76df-488d-4f5e-8384-60771ee03674', '70749212-2218-487d-8d63-d6024af6f8dd', '6f76d19e-441a-4a34-a346-45cac8c98471'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d86dc824-e143-4040-b171-2df702e553c8 tempest-VolumesExtendTest-1035852545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d86dc824-e143-4040-b171-2df702e553c8 tempest-VolumesExtendTest-1035852545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d86dc824-e143-4040-b171-2df702e553c8 tempest-VolumesExtendTest-1035852545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d86dc824-e143-4040-b171-2df702e553c8 tempest-VolumesExtendTest-1035852545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d86dc824-e143-4040-b171-2df702e553c8 tempest-VolumesExtendTest-1035852545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d86dc824-e143-4040-b171-2df702e553c8 tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:03 devstack sudo[98840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:58:03 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:03 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-45f8855a-0cf8-4711-bbe9-4826f972f6ce 1073741824" returned: 0 in 0.674s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-45f8855a-0cf8-4711-bbe9-4826f972f6ce {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:03 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-45f8855a-0cf8-4711-bbe9-4826f972f6ce Sep 04 15:58:03 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:03 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d86dc824-e143-4040-b171-2df702e553c8 tempest-VolumesExtendTest-1035852545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.273s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d86dc824-e143-4040-b171-2df702e553c8 tempest-VolumesExtendTest-1035852545 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:58:03 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-d86dc824-e143-4040-b171-2df702e553c8 tempest-VolumesExtendTest-1035852545 None] Deleted volume successfully. Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d86dc824-e143-4040-b171-2df702e553c8 tempest-VolumesExtendTest-1035852545 None] Lock "cinder-c683ca1e-7337-463c-9aad-cbc11a5f9936-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:03 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-45f8855a-0cf8-4711-bbe9-4826f972f6ce" returned: 0 in 0.311s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.566s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-897562207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baedaa56-0ea2-4bb5-b5c6-da308406a9f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a9a976d6d44d17bbfdb01837ee3a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:03Z,use_quota=True,user_id='c64105a263944a91bc1166cf17d57624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Creating volume baedaa56-0ea2-4bb5-b5c6-da308406a9f5 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:58:03 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-baedaa56-0ea2-4bb5-b5c6-da308406a9f5 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:03 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-baedaa56-0ea2-4bb5-b5c6-da308406a9f5 1073741824 Sep 04 15:58:03 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Attempting download of 45f30594-eb99-4489-8426-17288dc4314b ((None, [{'url': 'file:///opt/stack/data/glance/images/45f30594-eb99-4489-8426-17288dc4314b', 'metadata': {}}])) to volume 45f8855a-0cf8-4711-bbe9-4826f972f6ce. {{(pid=87490) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f6fc8d-b731-4c9a-aa35-af3570e675a8]: (4, 'raw') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45f30594-eb99-4489-8426-17288dc4314b_4bd2uddm {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:03 devstack sudo[98848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45f30594-eb99-4489-8426-17288dc4314b_4bd2uddm Sep 04 15:58:03 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:04 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45f30594-eb99-4489-8426-17288dc4314b_4bd2uddm" returned: 0 in 0.421s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45f30594-eb99-4489-8426-17288dc4314b_4bd2uddm {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:04 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-baedaa56-0ea2-4bb5-b5c6-da308406a9f5 1073741824" returned: 0 in 0.575s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-baedaa56-0ea2-4bb5-b5c6-da308406a9f5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:04 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45f30594-eb99-4489-8426-17288dc4314b_4bd2uddm Sep 04 15:58:04 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:04 devstack sudo[98857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-baedaa56-0ea2-4bb5-b5c6-da308406a9f5 Sep 04 15:58:04 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:04 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45f30594-eb99-4489-8426-17288dc4314b_4bd2uddm" returned: 1 in 0.361s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45f30594-eb99-4489-8426-17288dc4314b_4bd2uddm' failed. Not Retrying. {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbea47cf-4d01-4caa-b8e7-b8a7766e3a2a]: (4, 'raw') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45f30594-eb99-4489-8426-17288dc4314b_punnu155devstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:04 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-baedaa56-0ea2-4bb5-b5c6-da308406a9f5" returned: 0 in 0.354s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be1a8cdf-2a39-49e8-82ca-80fc7f29c0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baedaa56-0ea2-4bb5-b5c6-da308406a9f5', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:04 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45f30594-eb99-4489-8426-17288dc4314b_punnu155devstack@QuobyteHD Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eff15c7-ba8a-4066-87d3-728589b904a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:04 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:04 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Volume volume-baedaa56-0ea2-4bb5-b5c6-da308406a9f5 (baedaa56-0ea2-4bb5-b5c6-da308406a9f5): created successfully Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eff15c7-ba8a-4066-87d3-728589b904a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Flow 'volume_create_manager' (1c8e1ed4-1382-41fa-9a14-1918846e49f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:04 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-69ed43a6-a19e-4c64-9a4a-84c3c6eef901 tempest-VolumesActionsTest-524639293 None] Created volume successfully. Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Flow 'volume_create_manager' (42ea440b-1cf7-4ff0-8540-618639519c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b8e8003-c5b4-4171-b4d3-c3d16a56a32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b8e8003-c5b4-4171-b4d3-c3d16a56a32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-755124192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a424b14-5f92-4169-a05e-aee50d333d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f760007a8a94335a12ba467a8378fad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:05Z,use_quota=True,user_id='20285c2abcab423a8a61ac442f6f7ac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad3b9b1-a4c7-4fba-ab06-c12fe0b7793f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad3b9b1-a4c7-4fba-ab06-c12fe0b7793f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21fea10a-685b-4f2c-8830-ef4a5e499d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21fea10a-685b-4f2c-8830-ef4a5e499d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a424b14-5f92-4169-a05e-aee50d333d8c', 'volume_name': 'volume-4a424b14-5f92-4169-a05e-aee50d333d8c', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2caca139-1be5-4d08-9e5c-c4b86225e99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2caca139-1be5-4d08-9e5c-c4b86225e99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:04 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a91b85f6-9dcc-4952-900b-af90eac12a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:04 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Volume 4a424b14-5f92-4169-a05e-aee50d333d8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a424b14-5f92-4169-a05e-aee50d333d8c', 'volume_size': 1} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-755124192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a424b14-5f92-4169-a05e-aee50d333d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f760007a8a94335a12ba467a8378fad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:05Z,use_quota=True,user_id='20285c2abcab423a8a61ac442f6f7ac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Creating volume 4a424b14-5f92-4169-a05e-aee50d333d8c {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:58:04 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45f30594-eb99-4489-8426-17288dc4314b_punnu155devstack@QuobyteHD" returned: 0 in 0.482s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45f30594-eb99-4489-8426-17288dc4314b_punnu155devstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:04 devstack sudo[98867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c 1073741824 Sep 04 15:58:04 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:05 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45f30594-eb99-4489-8426-17288dc4314b_punnu155devstack@QuobyteHD Sep 04 15:58:05 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:05 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7df5c3db-5384-44d2-94fb-ce592511940b tempest-VolumesActionsTest-626533718 None] Acquiring lock "cinder-baedaa56-0ea2-4bb5-b5c6-da308406a9f5-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:05 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7df5c3db-5384-44d2-94fb-ce592511940b tempest-VolumesActionsTest-626533718 None] Lock "cinder-baedaa56-0ea2-4bb5-b5c6-da308406a9f5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:05 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7df5c3db-5384-44d2-94fb-ce592511940b tempest-VolumesActionsTest-626533718 None] Acquiring lock "cinder-quobyte-baedaa56-0ea2-4bb5-b5c6-da308406a9f5" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:05 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7df5c3db-5384-44d2-94fb-ce592511940b tempest-VolumesActionsTest-626533718 None] Lock "cinder-quobyte-baedaa56-0ea2-4bb5-b5c6-da308406a9f5" acquired by "delete_volume" :: waited 0.020s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:05 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[629d2f39-1e56-46e2-af27-9868ef104e37]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7df5c3db-5384-44d2-94fb-ce592511940b tempest-VolumesActionsTest-626533718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-baedaa56-0ea2-4bb5-b5c6-da308406a9f5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:05 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45f30594-eb99-4489-8426-17288dc4314b_punnu155devstack@QuobyteHD" returned: 1 in 0.465s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45f30594-eb99-4489-8426-17288dc4314b_punnu155devstack@QuobyteHD' failed. Not Retrying. {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:58:05 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] 45f30594-eb99-4489-8426-17288dc4314b was raw, converting to qcow2 {{(pid=87490) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 15:58:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_45f30594-eb99-4489-8426-17288dc4314b_punnu155devstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-45f8855a-0cf8-4711-bbe9-4826f972f6ce {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:05 devstack sudo[98879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_45f30594-eb99-4489-8426-17288dc4314b_punnu155devstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-45f8855a-0cf8-4711-bbe9-4826f972f6ce Sep 04 15:58:05 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:05 devstack sudo[98874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-baedaa56-0ea2-4bb5-b5c6-da308406a9f5 Sep 04 15:58:05 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:05 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c 1073741824" returned: 0 in 0.629s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:05 devstack sudo[98882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c Sep 04 15:58:05 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:05 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7df5c3db-5384-44d2-94fb-ce592511940b tempest-VolumesActionsTest-626533718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-baedaa56-0ea2-4bb5-b5c6-da308406a9f5" returned: 0 in 0.439s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7df5c3db-5384-44d2-94fb-ce592511940b tempest-VolumesActionsTest-626533718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-baedaa56-0ea2-4bb5-b5c6-da308406a9f5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:05 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-baedaa56-0ea2-4bb5-b5c6-da308406a9f5 Sep 04 15:58:05 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:05 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c" returned: 0 in 0.328s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:05 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:58:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:05 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a91b85f6-9dcc-4952-900b-af90eac12a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a424b14-5f92-4169-a05e-aee50d333d8c', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:05 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301ca05c-d7e7-46a9-b301-a83dfde92c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:05 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Volume volume-4a424b14-5f92-4169-a05e-aee50d333d8c (4a424b14-5f92-4169-a05e-aee50d333d8c): created successfully Sep 04 15:58:05 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301ca05c-d7e7-46a9-b301-a83dfde92c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:05 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Flow 'volume_create_manager' (42ea440b-1cf7-4ff0-8540-618639519c93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:05 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-daf8ff03-e154-4238-8aeb-41bdd500aedd tempest-VolumesExtendTest-1035852545 None] Created volume successfully. Sep 04 15:58:05 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_45f30594-eb99-4489-8426-17288dc4314b_punnu155devstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-45f8855a-0cf8-4711-bbe9-4826f972f6ce" returned: 0 in 0.628s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:05 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_45f30594-eb99-4489-8426-17288dc4314b_punnu155devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-45f8855a-0cf8-4711-bbe9-4826f972f6ce {{(pid=87490) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 15:58:05 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Converted 0.00 MB image at 0.00 MB/s Sep 04 15:58:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-45f8855a-0cf8-4711-bbe9-4826f972f6ce 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:06 devstack sudo[98894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-45f8855a-0cf8-4711-bbe9-4826f972f6ce 1G Sep 04 15:58:06 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:06 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7df5c3db-5384-44d2-94fb-ce592511940b tempest-VolumesActionsTest-626533718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-baedaa56-0ea2-4bb5-b5c6-da308406a9f5" returned: 0 in 0.404s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7df5c3db-5384-44d2-94fb-ce592511940b tempest-VolumesActionsTest-626533718 None] Lock "cinder-quobyte-baedaa56-0ea2-4bb5-b5c6-da308406a9f5" released by "delete_volume" :: held 0.897s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:06 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-7df5c3db-5384-44d2-94fb-ce592511940b tempest-VolumesActionsTest-626533718 None] Created reservations ['4ca452c7-db9e-4577-bd31-19b6bcaf61e4', '3039ad3f-573d-47c1-a464-b23473ca5e7c', '6b542ebf-e2f0-442f-a47c-cb055bf4a1dc', '80384717-af3e-4d4d-af88-400857b09953'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:58:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7df5c3db-5384-44d2-94fb-ce592511940b tempest-VolumesActionsTest-626533718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7df5c3db-5384-44d2-94fb-ce592511940b tempest-VolumesActionsTest-626533718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:06 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7df5c3db-5384-44d2-94fb-ce592511940b tempest-VolumesActionsTest-626533718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:06 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7df5c3db-5384-44d2-94fb-ce592511940b tempest-VolumesActionsTest-626533718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7df5c3db-5384-44d2-94fb-ce592511940b tempest-VolumesActionsTest-626533718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7df5c3db-5384-44d2-94fb-ce592511940b tempest-VolumesActionsTest-626533718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:06 devstack sudo[98900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:58:06 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:06 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-45f8855a-0cf8-4711-bbe9-4826f972f6ce 1G" returned: 0 in 0.438s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:06 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Downloaded image 45f30594-eb99-4489-8426-17288dc4314b ((None, [{'url': 'file:///opt/stack/data/glance/images/45f30594-eb99-4489-8426-17288dc4314b', 'metadata': {}}])) to volume 45f8855a-0cf8-4711-bbe9-4826f972f6ce successfully. {{(pid=87490) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 15:58:06 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Temporary image 45f30594-eb99-4489-8426-17288dc4314b for user b893e74d17034c179891e21221e47d90 is deleted. {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 15:58:06 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Marking volume 45f8855a-0cf8-4711-bbe9-4826f972f6ce as bootable. {{(pid=87490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 15:58:06 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Copying metadata from image 45f30594-eb99-4489-8426-17288dc4314b to 45f8855a-0cf8-4711-bbe9-4826f972f6ce. {{(pid=87490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 15:58:06 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Creating volume glance metadata for volume 45f8855a-0cf8-4711-bbe9-4826f972f6ce backed by image 45f30594-eb99-4489-8426-17288dc4314b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '45f30594-eb99-4489-8426-17288dc4314b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2b02766318b6a587f86e83f7d10587ef', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87490) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 15:58:06 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e909ed9b-f797-4ffc-9218-68e5d1a246ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45f8855a-0cf8-4711-bbe9-4826f972f6ce', 'volume_size': 1, 'image_id': '45f30594-eb99-4489-8426-17288dc4314b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45f30594-eb99-4489-8426-17288dc4314b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2b02766318b6a587f86e83f7d10587ef', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c13174935add48d69e85a2edd4261bc7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e843ba7f2c2af836fee6b3c12ab70bf7a199795347871dc3269cdd95b5792b5da53490da41c98981c572afe6a4d966fa211cf7b6c54e85f5c555db95e84583d2', 'id': '45f30594-eb99-4489-8426-17288dc4314b', 'created_at': datetime.datetime(2026, 9, 4, 13, 57, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 57, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45f30594-eb99-4489-8426-17288dc4314b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:06 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4474b316-20ee-40c7-8b24-cc158419e72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:06 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Volume volume-45f8855a-0cf8-4711-bbe9-4826f972f6ce (45f8855a-0cf8-4711-bbe9-4826f972f6ce): created successfully Sep 04 15:58:06 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4474b316-20ee-40c7-8b24-cc158419e72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:06 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Flow 'volume_create_manager' (629f9cbf-dcce-4706-9320-1ef0b40c57e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:06 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-24c982de-32a4-42f7-adaf-7ae08b1b721a tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Created volume successfully. Sep 04 15:58:06 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7df5c3db-5384-44d2-94fb-ce592511940b tempest-VolumesActionsTest-626533718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.296s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:06 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-7df5c3db-5384-44d2-94fb-ce592511940b tempest-VolumesActionsTest-626533718 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:58:06 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-7df5c3db-5384-44d2-94fb-ce592511940b tempest-VolumesActionsTest-626533718 None] Deleted volume successfully. Sep 04 15:58:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7df5c3db-5384-44d2-94fb-ce592511940b tempest-VolumesActionsTest-626533718 None] Lock "cinder-baedaa56-0ea2-4bb5-b5c6-da308406a9f5-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8d1e6726-17b6-4204-bf18-cc5e66ad043d tempest-VolumesExtendTest-1035852545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8d1e6726-17b6-4204-bf18-cc5e66ad043d tempest-VolumesExtendTest-1035852545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1c423fbb-1472-4e99-ad72-d6e583712d55 tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Acquiring lock "cinder-45f8855a-0cf8-4711-bbe9-4826f972f6ce-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:07 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:58:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Flow 'volume_create_manager' (9141b749-f8b3-4bc5-b21a-1c2ab41dfa35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3788b016-62f8-4fd0-ae82-cf8b07ab71b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:07 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-8d1e6726-17b6-4204-bf18-cc5e66ad043d tempest-VolumesExtendTest-1035852545 None] Creating offline snapshot a8c8ae18-9180-42ec-825b-e936b9d28c4b of volume 4a424b14-5f92-4169-a05e-aee50d333d8c {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:58:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3788b016-62f8-4fd0-ae82-cf8b07ab71b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1288487589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a9a976d6d44d17bbfdb01837ee3a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:07Z,use_quota=True,user_id='c64105a263944a91bc1166cf17d57624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a7ee56d-495b-4ea7-8064-aa8e0ca3a503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a7ee56d-495b-4ea7-8064-aa8e0ca3a503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (121c7404-b970-467c-be14-6e1b0c8fb689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (121c7404-b970-467c-be14-6e1b0c8fb689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc', 'volume_name': 'volume-b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01c11cef-5b13-4a83-b688-ab3bc1d4e780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01c11cef-5b13-4a83-b688-ab3bc1d4e780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea63151-d471-43f2-8935-37aa189fbaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:07 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Volume b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc', 'volume_size': 1} Sep 04 15:58:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:07 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c02512-8385-4a6c-8061-d98d74cb6dcf]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1c423fbb-1472-4e99-ad72-d6e583712d55 tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Lock "cinder-45f8855a-0cf8-4711-bbe9-4826f972f6ce-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8d1e6726-17b6-4204-bf18-cc5e66ad043d tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1c423fbb-1472-4e99-ad72-d6e583712d55 tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Acquiring lock "cinder-quobyte-45f8855a-0cf8-4711-bbe9-4826f972f6ce" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1c423fbb-1472-4e99-ad72-d6e583712d55 tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Lock "cinder-quobyte-45f8855a-0cf8-4711-bbe9-4826f972f6ce" acquired by "delete_volume" :: waited 0.019s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:07 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c61c27f-96a7-41ee-81e6-2ba0b533e0e6]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1c423fbb-1472-4e99-ad72-d6e583712d55 tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-45f8855a-0cf8-4711-bbe9-4826f972f6ce {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:07 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c Sep 04 15:58:07 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:07 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-45f8855a-0cf8-4711-bbe9-4826f972f6ce Sep 04 15:58:07 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:07 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8d1e6726-17b6-4204-bf18-cc5e66ad043d tempest-VolumesExtendTest-1035852545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c" returned: 0 in 0.394s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8d1e6726-17b6-4204-bf18-cc5e66ad043d tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.a8c8ae18-9180-42ec-825b-e936b9d28c4b 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:07 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.a8c8ae18-9180-42ec-825b-e936b9d28c4b 1G Sep 04 15:58:07 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:07 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1c423fbb-1472-4e99-ad72-d6e583712d55 tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-45f8855a-0cf8-4711-bbe9-4826f972f6ce" returned: 0 in 0.404s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1c423fbb-1472-4e99-ad72-d6e583712d55 tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-45f8855a-0cf8-4711-bbe9-4826f972f6ce {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:07 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-45f8855a-0cf8-4711-bbe9-4826f972f6ce Sep 04 15:58:07 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:08 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1c423fbb-1472-4e99-ad72-d6e583712d55 tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-45f8855a-0cf8-4711-bbe9-4826f972f6ce" returned: 0 in 0.283s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:08 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1c423fbb-1472-4e99-ad72-d6e583712d55 tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Lock "cinder-quobyte-45f8855a-0cf8-4711-bbe9-4826f972f6ce" released by "delete_volume" :: held 0.727s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:08 devstack cinder-volume[87490]: WARNING cinder.quota [None req-1c423fbb-1472-4e99-ad72-d6e583712d55 tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:58:08 devstack cinder-volume[87490]: WARNING cinder.quota [None req-1c423fbb-1472-4e99-ad72-d6e583712d55 tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 04 15:58:08 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-1c423fbb-1472-4e99-ad72-d6e583712d55 tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Created reservations ['ab2c5884-4f47-4183-8ac3-a5ef937b0933', '8d3212f4-7119-4aa4-9ec3-db3ea9d33ac8', 'f331430e-7b0c-48bf-a2b7-7aa9ebca1434', '0ae38960-4037-486c-84d6-190b2918f04d'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:58:08 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8d1e6726-17b6-4204-bf18-cc5e66ad043d tempest-VolumesExtendTest-1035852545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.a8c8ae18-9180-42ec-825b-e936b9d28c4b 1G" returned: 0 in 0.493s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8d1e6726-17b6-4204-bf18-cc5e66ad043d tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a424b14-5f92-4169-a05e-aee50d333d8c -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.a8c8ae18-9180-42ec-825b-e936b9d28c4b {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:08 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a424b14-5f92-4169-a05e-aee50d333d8c -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.a8c8ae18-9180-42ec-825b-e936b9d28c4b Sep 04 15:58:08 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1c423fbb-1472-4e99-ad72-d6e583712d55 tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1c423fbb-1472-4e99-ad72-d6e583712d55 tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:08 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1c423fbb-1472-4e99-ad72-d6e583712d55 tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:08 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1c423fbb-1472-4e99-ad72-d6e583712d55 tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1c423fbb-1472-4e99-ad72-d6e583712d55 tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1c423fbb-1472-4e99-ad72-d6e583712d55 tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:08 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:58:08 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:08 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1c423fbb-1472-4e99-ad72-d6e583712d55 tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.303s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:08 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-1c423fbb-1472-4e99-ad72-d6e583712d55 tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:58:08 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8d1e6726-17b6-4204-bf18-cc5e66ad043d tempest-VolumesExtendTest-1035852545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a424b14-5f92-4169-a05e-aee50d333d8c -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.a8c8ae18-9180-42ec-825b-e936b9d28c4b" returned: 0 in 0.379s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:08 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-8d1e6726-17b6-4204-bf18-cc5e66ad043d tempest-VolumesExtendTest-1035852545 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.a8c8ae18-9180-42ec-825b-e936b9d28c4b is being set with open permissions: ugo+rw Sep 04 15:58:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8d1e6726-17b6-4204-bf18-cc5e66ad043d tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.a8c8ae18-9180-42ec-825b-e936b9d28c4b {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:08 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-1c423fbb-1472-4e99-ad72-d6e583712d55 tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Deleted volume successfully. Sep 04 15:58:08 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.a8c8ae18-9180-42ec-825b-e936b9d28c4b Sep 04 15:58:08 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:08 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1c423fbb-1472-4e99-ad72-d6e583712d55 tempest-VolumeAndVolumeTypeFromImageTest-1171688952 None] Lock "cinder-45f8855a-0cf8-4711-bbe9-4826f972f6ce-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:08 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8d1e6726-17b6-4204-bf18-cc5e66ad043d tempest-VolumesExtendTest-1035852545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.a8c8ae18-9180-42ec-825b-e936b9d28c4b" returned: 0 in 0.286s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8d1e6726-17b6-4204-bf18-cc5e66ad043d tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:08 devstack sudo[98934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.info Sep 04 15:58:08 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:09 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8d1e6726-17b6-4204-bf18-cc5e66ad043d tempest-VolumesExtendTest-1035852545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.info" returned: 0 in 0.279s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:09 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-8d1e6726-17b6-4204-bf18-cc5e66ad043d tempest-VolumesExtendTest-1035852545 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.info is being set with open permissions: ugo+rw Sep 04 15:58:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8d1e6726-17b6-4204-bf18-cc5e66ad043d tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:09 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.info Sep 04 15:58:09 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:09 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8d1e6726-17b6-4204-bf18-cc5e66ad043d tempest-VolumesExtendTest-1035852545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.info" returned: 0 in 0.292s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8d1e6726-17b6-4204-bf18-cc5e66ad043d tempest-VolumesExtendTest-1035852545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.328s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.207s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:09 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1288487589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a9a976d6d44d17bbfdb01837ee3a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:07Z,use_quota=True,user_id='c64105a263944a91bc1166cf17d57624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:58:09 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Creating volume b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:58:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:09 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:09 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:09 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:58:09 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:58:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:09 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc 1073741824 Sep 04 15:58:09 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:09 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-8d1e6726-17b6-4204-bf18-cc5e66ad043d tempest-VolumesExtendTest-1035852545 None] Create snapshot completed successfully Sep 04 15:58:10 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc 1073741824" returned: 0 in 0.561s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:10 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc Sep 04 15:58:10 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9ccf4e3f-66a2-4e71-831c-5d1f27789fae tempest-VolumesExtendTest-1035852545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:10 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc" returned: 0 in 0.357s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:58:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9ccf4e3f-66a2-4e71-831c-5d1f27789fae tempest-VolumesExtendTest-1035852545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.065s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:10 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10e3791-b9c6-4a3b-ad3d-00f25077e570]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9ccf4e3f-66a2-4e71-831c-5d1f27789fae tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea63151-d471-43f2-8935-37aa189fbaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f72b82b3-96e0-4f41-b74f-74eb8de70505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:10 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Volume volume-b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc (b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc): created successfully Sep 04 15:58:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f72b82b3-96e0-4f41-b74f-74eb8de70505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Flow 'volume_create_manager' (9141b749-f8b3-4bc5-b21a-1c2ab41dfa35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:10 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-f44435f2-7509-459b-afb2-6c7c4a1da001 tempest-VolumesActionsTest-524639293 None] Created volume successfully. Sep 04 15:58:10 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c Sep 04 15:58:10 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:11 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9ccf4e3f-66a2-4e71-831c-5d1f27789fae tempest-VolumesExtendTest-1035852545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c" returned: 0 in 0.465s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9ccf4e3f-66a2-4e71-831c-5d1f27789fae tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.a8c8ae18-9180-42ec-825b-e936b9d28c4b 2G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9ccf4e3f-66a2-4e71-831c-5d1f27789fae tempest-VolumesExtendTest-1035852545 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.a8c8ae18-9180-42ec-825b-e936b9d28c4b 2G" returned: 0 in 0.156s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9ccf4e3f-66a2-4e71-831c-5d1f27789fae tempest-VolumesExtendTest-1035852545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.712s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:11 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-9ccf4e3f-66a2-4e71-831c-5d1f27789fae tempest-VolumesExtendTest-1035852545 None] Extend volume completed successfully. Sep 04 15:58:11 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6d9752ee-40c7-4f3d-89d1-d3ddfdc8930f tempest-VolumesActionsTest-626533718 None] Acquiring lock "cinder-b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:11 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6d9752ee-40c7-4f3d-89d1-d3ddfdc8930f tempest-VolumesActionsTest-626533718 None] Lock "cinder-b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:11 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6d9752ee-40c7-4f3d-89d1-d3ddfdc8930f tempest-VolumesActionsTest-626533718 None] Acquiring lock "cinder-quobyte-b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:11 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6d9752ee-40c7-4f3d-89d1-d3ddfdc8930f tempest-VolumesActionsTest-626533718 None] Lock "cinder-quobyte-b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc" acquired by "delete_volume" :: waited 0.034s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:11 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94530f6-ee1c-4ff8-90f5-672713f55492]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6d9752ee-40c7-4f3d-89d1-d3ddfdc8930f tempest-VolumesActionsTest-626533718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:11 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6074f111-3592-4788-b0b6-89b8b1a37319 tempest-VolumesExtendTest-1035852545 None] Acquiring lock "cinder-a8c8ae18-9180-42ec-825b-e936b9d28c4b-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:11 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6074f111-3592-4788-b0b6-89b8b1a37319 tempest-VolumesExtendTest-1035852545 None] Lock "cinder-a8c8ae18-9180-42ec-825b-e936b9d28c4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:11 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6074f111-3592-4788-b0b6-89b8b1a37319 tempest-VolumesExtendTest-1035852545 None] Acquiring lock "cinder-quobyte-4a424b14-5f92-4169-a05e-aee50d333d8c" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:11 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc Sep 04 15:58:11 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:11 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6074f111-3592-4788-b0b6-89b8b1a37319 tempest-VolumesExtendTest-1035852545 None] Lock "cinder-quobyte-4a424b14-5f92-4169-a05e-aee50d333d8c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:11 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6074f111-3592-4788-b0b6-89b8b1a37319 tempest-VolumesExtendTest-1035852545 None] Acquiring lock "cinder-quobyte-a8c8ae18-9180-42ec-825b-e936b9d28c4b" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:11 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6074f111-3592-4788-b0b6-89b8b1a37319 tempest-VolumesExtendTest-1035852545 None] Lock "cinder-quobyte-a8c8ae18-9180-42ec-825b-e936b9d28c4b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:11 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-6074f111-3592-4788-b0b6-89b8b1a37319 tempest-VolumesExtendTest-1035852545 None] Deleting offline snapshot a8c8ae18-9180-42ec-825b-e936b9d28c4b of volume 4a424b14-5f92-4169-a05e-aee50d333d8c {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:58:11 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-6074f111-3592-4788-b0b6-89b8b1a37319 tempest-VolumesExtendTest-1035852545 None] snapshot_file for this snap is: volume-4a424b14-5f92-4169-a05e-aee50d333d8c.a8c8ae18-9180-42ec-825b-e936b9d28c4b {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:58:11 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b10917-7284-46b0-9c53-ee8aaf1534dc]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6074f111-3592-4788-b0b6-89b8b1a37319 tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.a8c8ae18-9180-42ec-825b-e936b9d28c4b {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:12 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.a8c8ae18-9180-42ec-825b-e936b9d28c4b Sep 04 15:58:12 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:12 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6d9752ee-40c7-4f3d-89d1-d3ddfdc8930f tempest-VolumesActionsTest-626533718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc" returned: 0 in 0.450s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6d9752ee-40c7-4f3d-89d1-d3ddfdc8930f tempest-VolumesActionsTest-626533718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:12 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc Sep 04 15:58:12 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:12 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6074f111-3592-4788-b0b6-89b8b1a37319 tempest-VolumesExtendTest-1035852545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.a8c8ae18-9180-42ec-825b-e936b9d28c4b" returned: 0 in 0.436s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-6074f111-3592-4788-b0b6-89b8b1a37319 tempest-VolumesExtendTest-1035852545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a424b14-5f92-4169-a05e-aee50d333d8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:58:12 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a6cc2a-4549-4dad-939d-09f36b9fe971]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6074f111-3592-4788-b0b6-89b8b1a37319 tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:12 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6d9752ee-40c7-4f3d-89d1-d3ddfdc8930f tempest-VolumesActionsTest-626533718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc" returned: 0 in 0.295s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6d9752ee-40c7-4f3d-89d1-d3ddfdc8930f tempest-VolumesActionsTest-626533718 None] Lock "cinder-quobyte-b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc" released by "delete_volume" :: held 0.834s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:12 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c Sep 04 15:58:12 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:12 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-6d9752ee-40c7-4f3d-89d1-d3ddfdc8930f tempest-VolumesActionsTest-626533718 None] Created reservations ['a2b7f20f-2dfa-4ce7-9010-95772288be87', 'baf39214-4753-4d52-8946-4358c561a74e', '91598ee9-1396-4f8e-9049-77d673f4a2d9', '8c0245b3-ae07-4ee9-bea7-dd9260f5855d'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:58:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6d9752ee-40c7-4f3d-89d1-d3ddfdc8930f tempest-VolumesActionsTest-626533718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6d9752ee-40c7-4f3d-89d1-d3ddfdc8930f tempest-VolumesActionsTest-626533718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-6d9752ee-40c7-4f3d-89d1-d3ddfdc8930f tempest-VolumesActionsTest-626533718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-6d9752ee-40c7-4f3d-89d1-d3ddfdc8930f tempest-VolumesActionsTest-626533718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6d9752ee-40c7-4f3d-89d1-d3ddfdc8930f tempest-VolumesActionsTest-626533718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6d9752ee-40c7-4f3d-89d1-d3ddfdc8930f tempest-VolumesActionsTest-626533718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:12 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:58:12 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:12 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6074f111-3592-4788-b0b6-89b8b1a37319 tempest-VolumesExtendTest-1035852545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c" returned: 0 in 0.402s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6074f111-3592-4788-b0b6-89b8b1a37319 tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.a8c8ae18-9180-42ec-825b-e936b9d28c4b {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:12 devstack sudo[98977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.a8c8ae18-9180-42ec-825b-e936b9d28c4b Sep 04 15:58:12 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:12 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6d9752ee-40c7-4f3d-89d1-d3ddfdc8930f tempest-VolumesActionsTest-626533718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.297s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:12 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-6d9752ee-40c7-4f3d-89d1-d3ddfdc8930f tempest-VolumesActionsTest-626533718 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:58:12 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-6d9752ee-40c7-4f3d-89d1-d3ddfdc8930f tempest-VolumesActionsTest-626533718 None] Deleted volume successfully. Sep 04 15:58:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6d9752ee-40c7-4f3d-89d1-d3ddfdc8930f tempest-VolumesActionsTest-626533718 None] Lock "cinder-b0210a72-2ac6-41e2-b71c-8cb2cafb6fbc-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:13 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6074f111-3592-4788-b0b6-89b8b1a37319 tempest-VolumesExtendTest-1035852545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.a8c8ae18-9180-42ec-825b-e936b9d28c4b" returned: 0 in 0.466s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6074f111-3592-4788-b0b6-89b8b1a37319 tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.a8c8ae18-9180-42ec-825b-e936b9d28c4b {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:13 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.a8c8ae18-9180-42ec-825b-e936b9d28c4b Sep 04 15:58:13 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:58:13 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Flow 'volume_create_manager' (f3f7a408-08bc-490f-9e01-12a74f3be9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef15ead-747c-4d78-acda-686b1f780638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6074f111-3592-4788-b0b6-89b8b1a37319 tempest-VolumesExtendTest-1035852545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c.a8c8ae18-9180-42ec-825b-e936b9d28c4b" returned: 0 in 0.271s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef15ead-747c-4d78-acda-686b1f780638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1163926882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5711792a-b2d6-4de2-b284-1a302a12f667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a9a976d6d44d17bbfdb01837ee3a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:13Z,use_quota=True,user_id='c64105a263944a91bc1166cf17d57624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8309f99e-9fa8-4dc4-be0c-b4ad33a599eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8309f99e-9fa8-4dc4-be0c-b4ad33a599eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe77b5d-5814-42ff-b1bd-fe7929ece9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe77b5d-5814-42ff-b1bd-fe7929ece9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5711792a-b2d6-4de2-b284-1a302a12f667', 'volume_name': 'volume-5711792a-b2d6-4de2-b284-1a302a12f667', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b18176fa-c9ef-47ea-b6e1-4c96932b4e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b18176fa-c9ef-47ea-b6e1-4c96932b4e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0436ef66-4293-49a9-8ea2-2ac6c0b85f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:13 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Volume 5711792a-b2d6-4de2-b284-1a302a12f667: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5711792a-b2d6-4de2-b284-1a302a12f667', 'volume_size': 1} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1163926882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5711792a-b2d6-4de2-b284-1a302a12f667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a9a976d6d44d17bbfdb01837ee3a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:13Z,use_quota=True,user_id='c64105a263944a91bc1166cf17d57624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Creating volume 5711792a-b2d6-4de2-b284-1a302a12f667 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:58:13 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5711792a-b2d6-4de2-b284-1a302a12f667 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:13 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5711792a-b2d6-4de2-b284-1a302a12f667 1073741824 Sep 04 15:58:13 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6074f111-3592-4788-b0b6-89b8b1a37319 tempest-VolumesExtendTest-1035852545 None] Lock "cinder-quobyte-a8c8ae18-9180-42ec-825b-e936b9d28c4b" released by "_delete_snapshot" :: held 1.761s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Flow 'volume_create_manager' (8cc63164-48a2-4f7a-9eb0-bd800d6d0b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adcbc5a0-96a9-45db-b538-040372f19575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6074f111-3592-4788-b0b6-89b8b1a37319 tempest-VolumesExtendTest-1035852545 None] Lock "cinder-quobyte-4a424b14-5f92-4169-a05e-aee50d333d8c" released by "delete_snapshot" :: held 1.818s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adcbc5a0-96a9-45db-b538-040372f19575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-759829859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a31e8a1-345e-457d-87ac-a70c72bd7f0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fc741ce7664d889b91592d1752df56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:14Z,use_quota=True,user_id='0ac243fd401b4c66abc0fcce4c7ed151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01c18ed8-5bd6-4ddc-9b77-82c1d107e989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01c18ed8-5bd6-4ddc-9b77-82c1d107e989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56c6c621-d538-4613-abf5-a78a553291c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56c6c621-d538-4613-abf5-a78a553291c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a31e8a1-345e-457d-87ac-a70c72bd7f0b', 'volume_name': 'volume-4a31e8a1-345e-457d-87ac-a70c72bd7f0b', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1613633d-1061-4b80-832f-3170ed92efde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1613633d-1061-4b80-832f-3170ed92efde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d13019-d3e2-4670-9020-2ed501f6a920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:13 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Volume 4a31e8a1-345e-457d-87ac-a70c72bd7f0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a31e8a1-345e-457d-87ac-a70c72bd7f0b', 'volume_size': 1} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-6074f111-3592-4788-b0b6-89b8b1a37319 tempest-VolumesExtendTest-1035852545 None] Created reservations ['351ce4fd-88dc-47d2-903a-14f70adc0b2e', 'dcd18e93-ee29-4393-a660-e5124adeffd9', 'b02b9284-f531-49c3-bd48-8c9aba592d37', '72474d25-9a5c-44f2-ac8c-4ad1dd5a4be8'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:58:13 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-6074f111-3592-4788-b0b6-89b8b1a37319 tempest-VolumesExtendTest-1035852545 None] Delete snapshot completed successfully. Sep 04 15:58:13 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6074f111-3592-4788-b0b6-89b8b1a37319 tempest-VolumesExtendTest-1035852545 None] Lock "cinder-a8c8ae18-9180-42ec-825b-e936b9d28c4b-delete_snapshot" released by "delete_snapshot" :: held 2.003s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:14 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5711792a-b2d6-4de2-b284-1a302a12f667 1073741824" returned: 0 in 0.423s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5711792a-b2d6-4de2-b284-1a302a12f667 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:14 devstack sudo[98992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5711792a-b2d6-4de2-b284-1a302a12f667 Sep 04 15:58:14 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:14 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5711792a-b2d6-4de2-b284-1a302a12f667" returned: 0 in 0.248s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.571s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-759829859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a31e8a1-345e-457d-87ac-a70c72bd7f0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fc741ce7664d889b91592d1752df56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:14Z,use_quota=True,user_id='0ac243fd401b4c66abc0fcce4c7ed151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Creating volume 4a31e8a1-345e-457d-87ac-a70c72bd7f0b {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:58:14 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a31e8a1-345e-457d-87ac-a70c72bd7f0b 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0436ef66-4293-49a9-8ea2-2ac6c0b85f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5711792a-b2d6-4de2-b284-1a302a12f667', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:14 devstack sudo[98995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a31e8a1-345e-457d-87ac-a70c72bd7f0b 1073741824 Sep 04 15:58:14 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac2c7bb-dc90-496d-a750-64e2bb0d48eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:14 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Volume volume-5711792a-b2d6-4de2-b284-1a302a12f667 (5711792a-b2d6-4de2-b284-1a302a12f667): created successfully Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac2c7bb-dc90-496d-a750-64e2bb0d48eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Flow 'volume_create_manager' (f3f7a408-08bc-490f-9e01-12a74f3be9ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-907fee6b-ac90-4087-9b15-fbcb86364a02 tempest-VolumesExtendTest-1035852545 None] Acquiring lock "cinder-4a424b14-5f92-4169-a05e-aee50d333d8c-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:14 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-55889231-5481-4f7d-a060-18dc1879661d tempest-VolumesActionsTest-524639293 None] Created volume successfully. Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-907fee6b-ac90-4087-9b15-fbcb86364a02 tempest-VolumesExtendTest-1035852545 None] Lock "cinder-4a424b14-5f92-4169-a05e-aee50d333d8c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-907fee6b-ac90-4087-9b15-fbcb86364a02 tempest-VolumesExtendTest-1035852545 None] Acquiring lock "cinder-quobyte-4a424b14-5f92-4169-a05e-aee50d333d8c" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-907fee6b-ac90-4087-9b15-fbcb86364a02 tempest-VolumesExtendTest-1035852545 None] Lock "cinder-quobyte-4a424b14-5f92-4169-a05e-aee50d333d8c" acquired by "delete_volume" :: waited 0.013s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe6e95d-3cf7-484b-b29c-d1b09740f886]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-907fee6b-ac90-4087-9b15-fbcb86364a02 tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:14 devstack sudo[98997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c Sep 04 15:58:14 devstack sudo[98997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:14 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a31e8a1-345e-457d-87ac-a70c72bd7f0b 1073741824" returned: 0 in 0.423s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a31e8a1-345e-457d-87ac-a70c72bd7f0b {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:14 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a31e8a1-345e-457d-87ac-a70c72bd7f0b Sep 04 15:58:14 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:14 devstack sudo[98997]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-907fee6b-ac90-4087-9b15-fbcb86364a02 tempest-VolumesExtendTest-1035852545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c" returned: 0 in 0.369s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-907fee6b-ac90-4087-9b15-fbcb86364a02 tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:14 devstack sudo[99009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c Sep 04 15:58:14 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:15 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a31e8a1-345e-457d-87ac-a70c72bd7f0b" returned: 0 in 0.248s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d13019-d3e2-4670-9020-2ed501f6a920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a31e8a1-345e-457d-87ac-a70c72bd7f0b', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e65f3860-8faa-4303-bde4-c0c79a5de8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:15 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Volume volume-4a31e8a1-345e-457d-87ac-a70c72bd7f0b (4a31e8a1-345e-457d-87ac-a70c72bd7f0b): created successfully Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e65f3860-8faa-4303-bde4-c0c79a5de8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Flow 'volume_create_manager' (8cc63164-48a2-4f7a-9eb0-bd800d6d0b5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:15 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-1efe5024-8701-42b1-851a-3e846a46a792 tempest-VolumeQuotasAdminTestJSON-326845847 None] Created volume successfully. Sep 04 15:58:15 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-907fee6b-ac90-4087-9b15-fbcb86364a02 tempest-VolumesExtendTest-1035852545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a424b14-5f92-4169-a05e-aee50d333d8c" returned: 0 in 0.253s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-907fee6b-ac90-4087-9b15-fbcb86364a02 tempest-VolumesExtendTest-1035852545 None] Lock "cinder-quobyte-4a424b14-5f92-4169-a05e-aee50d333d8c" released by "delete_volume" :: held 0.673s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-907fee6b-ac90-4087-9b15-fbcb86364a02 tempest-VolumesExtendTest-1035852545 None] Created reservations ['783d1399-01ce-411c-be2e-34084a14962e', '2c6b67d3-4ac3-46d0-b27b-3aae53a12e6e', '04bfbb84-d642-4ea1-9de7-4d2c3ab41b1f', 'b69200f6-173e-43de-84a3-0c7b2b7321e2'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-907fee6b-ac90-4087-9b15-fbcb86364a02 tempest-VolumesExtendTest-1035852545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-907fee6b-ac90-4087-9b15-fbcb86364a02 tempest-VolumesExtendTest-1035852545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-907fee6b-ac90-4087-9b15-fbcb86364a02 tempest-VolumesExtendTest-1035852545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-907fee6b-ac90-4087-9b15-fbcb86364a02 tempest-VolumesExtendTest-1035852545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-907fee6b-ac90-4087-9b15-fbcb86364a02 tempest-VolumesExtendTest-1035852545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-907fee6b-ac90-4087-9b15-fbcb86364a02 tempest-VolumesExtendTest-1035852545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:15 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:58:15 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:15 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-907fee6b-ac90-4087-9b15-fbcb86364a02 tempest-VolumesExtendTest-1035852545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.283s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-907fee6b-ac90-4087-9b15-fbcb86364a02 tempest-VolumesExtendTest-1035852545 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:58:15 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-907fee6b-ac90-4087-9b15-fbcb86364a02 tempest-VolumesExtendTest-1035852545 None] Deleted volume successfully. Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0f35a5da-5b80-4afa-b841-c3fd6434eec3 tempest-VolumeQuotasAdminTestJSON-326845847 None] Acquiring lock "cinder-4a31e8a1-345e-457d-87ac-a70c72bd7f0b-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-907fee6b-ac90-4087-9b15-fbcb86364a02 tempest-VolumesExtendTest-1035852545 None] Lock "cinder-4a424b14-5f92-4169-a05e-aee50d333d8c-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0f35a5da-5b80-4afa-b841-c3fd6434eec3 tempest-VolumeQuotasAdminTestJSON-326845847 None] Lock "cinder-4a31e8a1-345e-457d-87ac-a70c72bd7f0b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0f35a5da-5b80-4afa-b841-c3fd6434eec3 tempest-VolumeQuotasAdminTestJSON-326845847 None] Acquiring lock "cinder-quobyte-4a31e8a1-345e-457d-87ac-a70c72bd7f0b" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-14a79e13-02c2-4928-8faf-fd1c2f1756a9 tempest-VolumesActionsTest-626533718 None] Acquiring lock "cinder-5711792a-b2d6-4de2-b284-1a302a12f667-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-14a79e13-02c2-4928-8faf-fd1c2f1756a9 tempest-VolumesActionsTest-626533718 None] Lock "cinder-5711792a-b2d6-4de2-b284-1a302a12f667-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0f35a5da-5b80-4afa-b841-c3fd6434eec3 tempest-VolumeQuotasAdminTestJSON-326845847 None] Lock "cinder-quobyte-4a31e8a1-345e-457d-87ac-a70c72bd7f0b" acquired by "delete_volume" :: waited 0.035s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f83a1e-9342-4e53-9522-41de8b465eca]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0f35a5da-5b80-4afa-b841-c3fd6434eec3 tempest-VolumeQuotasAdminTestJSON-326845847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a31e8a1-345e-457d-87ac-a70c72bd7f0b {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-14a79e13-02c2-4928-8faf-fd1c2f1756a9 tempest-VolumesActionsTest-626533718 None] Acquiring lock "cinder-quobyte-5711792a-b2d6-4de2-b284-1a302a12f667" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-14a79e13-02c2-4928-8faf-fd1c2f1756a9 tempest-VolumesActionsTest-626533718 None] Lock "cinder-quobyte-5711792a-b2d6-4de2-b284-1a302a12f667" acquired by "delete_volume" :: waited 0.026s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6a11bc-87a9-4c23-86f5-5df7049d5892]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-14a79e13-02c2-4928-8faf-fd1c2f1756a9 tempest-VolumesActionsTest-626533718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5711792a-b2d6-4de2-b284-1a302a12f667 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:15 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a31e8a1-345e-457d-87ac-a70c72bd7f0b Sep 04 15:58:15 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:15 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5711792a-b2d6-4de2-b284-1a302a12f667 Sep 04 15:58:15 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:16 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0f35a5da-5b80-4afa-b841-c3fd6434eec3 tempest-VolumeQuotasAdminTestJSON-326845847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a31e8a1-345e-457d-87ac-a70c72bd7f0b" returned: 0 in 0.420s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0f35a5da-5b80-4afa-b841-c3fd6434eec3 tempest-VolumeQuotasAdminTestJSON-326845847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a31e8a1-345e-457d-87ac-a70c72bd7f0b {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:16 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a31e8a1-345e-457d-87ac-a70c72bd7f0b Sep 04 15:58:16 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:16 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-14a79e13-02c2-4928-8faf-fd1c2f1756a9 tempest-VolumesActionsTest-626533718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5711792a-b2d6-4de2-b284-1a302a12f667" returned: 0 in 0.433s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-14a79e13-02c2-4928-8faf-fd1c2f1756a9 tempest-VolumesActionsTest-626533718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5711792a-b2d6-4de2-b284-1a302a12f667 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:16 devstack sudo[99029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5711792a-b2d6-4de2-b284-1a302a12f667 Sep 04 15:58:16 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:16 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0f35a5da-5b80-4afa-b841-c3fd6434eec3 tempest-VolumeQuotasAdminTestJSON-326845847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4a31e8a1-345e-457d-87ac-a70c72bd7f0b" returned: 0 in 0.279s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0f35a5da-5b80-4afa-b841-c3fd6434eec3 tempest-VolumeQuotasAdminTestJSON-326845847 None] Lock "cinder-quobyte-4a31e8a1-345e-457d-87ac-a70c72bd7f0b" released by "delete_volume" :: held 0.760s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:16 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-0f35a5da-5b80-4afa-b841-c3fd6434eec3 tempest-VolumeQuotasAdminTestJSON-326845847 None] Created reservations ['2e90b2a0-ff7a-41e8-b5eb-3c76074d19ac', '5fa122f7-e6f1-4208-92dc-21b6543dc16a', 'fb6701a7-41b6-4e16-b6c0-e68a17b01587', '15e8eaf1-17e4-43af-8a8d-ea3f809c1161'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:58:16 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-14a79e13-02c2-4928-8faf-fd1c2f1756a9 tempest-VolumesActionsTest-626533718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5711792a-b2d6-4de2-b284-1a302a12f667" returned: 0 in 0.283s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-14a79e13-02c2-4928-8faf-fd1c2f1756a9 tempest-VolumesActionsTest-626533718 None] Lock "cinder-quobyte-5711792a-b2d6-4de2-b284-1a302a12f667" released by "delete_volume" :: held 0.771s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0f35a5da-5b80-4afa-b841-c3fd6434eec3 tempest-VolumeQuotasAdminTestJSON-326845847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0f35a5da-5b80-4afa-b841-c3fd6434eec3 tempest-VolumeQuotasAdminTestJSON-326845847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-0f35a5da-5b80-4afa-b841-c3fd6434eec3 tempest-VolumeQuotasAdminTestJSON-326845847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-0f35a5da-5b80-4afa-b841-c3fd6434eec3 tempest-VolumeQuotasAdminTestJSON-326845847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0f35a5da-5b80-4afa-b841-c3fd6434eec3 tempest-VolumeQuotasAdminTestJSON-326845847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0f35a5da-5b80-4afa-b841-c3fd6434eec3 tempest-VolumeQuotasAdminTestJSON-326845847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:16 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-14a79e13-02c2-4928-8faf-fd1c2f1756a9 tempest-VolumesActionsTest-626533718 None] Created reservations ['bb7a768e-5363-4b36-baf8-fe54dab1f856', '232afe07-992d-464d-b2d6-0151f2dfd80b', 'dc770aaf-8749-4f67-9e6f-ca55e0b667d7', '1feab135-cc78-4ddd-b7ef-18e98cc95265'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:58:16 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:58:16 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-14a79e13-02c2-4928-8faf-fd1c2f1756a9 tempest-VolumesActionsTest-626533718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-14a79e13-02c2-4928-8faf-fd1c2f1756a9 tempest-VolumesActionsTest-626533718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-14a79e13-02c2-4928-8faf-fd1c2f1756a9 tempest-VolumesActionsTest-626533718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-14a79e13-02c2-4928-8faf-fd1c2f1756a9 tempest-VolumesActionsTest-626533718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-14a79e13-02c2-4928-8faf-fd1c2f1756a9 tempest-VolumesActionsTest-626533718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-14a79e13-02c2-4928-8faf-fd1c2f1756a9 tempest-VolumesActionsTest-626533718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:16 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:58:16 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:17 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0f35a5da-5b80-4afa-b841-c3fd6434eec3 tempest-VolumeQuotasAdminTestJSON-326845847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.399s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-0f35a5da-5b80-4afa-b841-c3fd6434eec3 tempest-VolumeQuotasAdminTestJSON-326845847 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:58:17 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-0f35a5da-5b80-4afa-b841-c3fd6434eec3 tempest-VolumeQuotasAdminTestJSON-326845847 None] Deleted volume successfully. Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0f35a5da-5b80-4afa-b841-c3fd6434eec3 tempest-VolumeQuotasAdminTestJSON-326845847 None] Lock "cinder-4a31e8a1-345e-457d-87ac-a70c72bd7f0b-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:17 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-14a79e13-02c2-4928-8faf-fd1c2f1756a9 tempest-VolumesActionsTest-626533718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.440s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-14a79e13-02c2-4928-8faf-fd1c2f1756a9 tempest-VolumesActionsTest-626533718 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:58:17 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-14a79e13-02c2-4928-8faf-fd1c2f1756a9 tempest-VolumesActionsTest-626533718 None] Deleted volume successfully. Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-14a79e13-02c2-4928-8faf-fd1c2f1756a9 tempest-VolumesActionsTest-626533718 None] Lock "cinder-5711792a-b2d6-4de2-b284-1a302a12f667-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Flow 'volume_create_manager' (4fc9d1e3-eeda-4be9-8c32-a71f50f5c84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6378e8a9-d2ea-4355-a5d9-fdb07c82d433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6378e8a9-d2ea-4355-a5d9-fdb07c82d433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-467529168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a68a84-b217-4a21-b645-47036a7c2cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fc741ce7664d889b91592d1752df56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:18Z,use_quota=True,user_id='0ac243fd401b4c66abc0fcce4c7ed151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde040d2-bbd1-4085-884d-0fb627b83c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde040d2-bbd1-4085-884d-0fb627b83c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0659b1c7-593e-4375-971c-21f4cdf68754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0659b1c7-593e-4375-971c-21f4cdf68754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8a68a84-b217-4a21-b645-47036a7c2cdc', 'volume_name': 'volume-c8a68a84-b217-4a21-b645-47036a7c2cdc', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f07c0c-c6a2-4b4f-84fe-d6e10c9e5ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f07c0c-c6a2-4b4f-84fe-d6e10c9e5ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d32cd2a-7edf-439a-b509-55e5ae68ce02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:17 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Volume c8a68a84-b217-4a21-b645-47036a7c2cdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8a68a84-b217-4a21-b645-47036a7c2cdc', 'volume_size': 1} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-467529168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a68a84-b217-4a21-b645-47036a7c2cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fc741ce7664d889b91592d1752df56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:18Z,use_quota=True,user_id='0ac243fd401b4c66abc0fcce4c7ed151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Creating volume c8a68a84-b217-4a21-b645-47036a7c2cdc {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:58:17 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c8a68a84-b217-4a21-b645-47036a7c2cdc 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:17 devstack sudo[99039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c8a68a84-b217-4a21-b645-47036a7c2cdc 1073741824 Sep 04 15:58:17 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Flow 'volume_create_manager' (68e20d43-09f4-4925-a75a-0868378fdefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a5f3229-0abb-479a-8392-a7b7971db368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a5f3229-0abb-479a-8392-a7b7971db368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-164951260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f32e1c-5354-466d-85f8-ce51da1aec83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a9a976d6d44d17bbfdb01837ee3a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:18Z,use_quota=True,user_id='c64105a263944a91bc1166cf17d57624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3de27bc-3878-4065-9a00-091a40f61bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3de27bc-3878-4065-9a00-091a40f61bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (722297c0-26dc-4bf3-b445-0869c42632b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (722297c0-26dc-4bf3-b445-0869c42632b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00f32e1c-5354-466d-85f8-ce51da1aec83', 'volume_name': 'volume-00f32e1c-5354-466d-85f8-ce51da1aec83', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87f26376-a44e-4626-992b-15250d5af023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87f26376-a44e-4626-992b-15250d5af023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89c3d194-fc9f-472b-8b4b-21e823d60676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:17 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Volume 00f32e1c-5354-466d-85f8-ce51da1aec83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00f32e1c-5354-466d-85f8-ce51da1aec83', 'volume_size': 1} Sep 04 15:58:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:18 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c8a68a84-b217-4a21-b645-47036a7c2cdc 1073741824" returned: 0 in 0.442s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c8a68a84-b217-4a21-b645-47036a7c2cdc {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:18 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c8a68a84-b217-4a21-b645-47036a7c2cdc Sep 04 15:58:18 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:18 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c8a68a84-b217-4a21-b645-47036a7c2cdc" returned: 0 in 0.263s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:58:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.615s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-164951260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f32e1c-5354-466d-85f8-ce51da1aec83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a9a976d6d44d17bbfdb01837ee3a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:18Z,use_quota=True,user_id='c64105a263944a91bc1166cf17d57624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:58:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Creating volume 00f32e1c-5354-466d-85f8-ce51da1aec83 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:58:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:58:18 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:58:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-00f32e1c-5354-466d-85f8-ce51da1aec83 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:18 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-00f32e1c-5354-466d-85f8-ce51da1aec83 1073741824 Sep 04 15:58:18 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d32cd2a-7edf-439a-b509-55e5ae68ce02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8a68a84-b217-4a21-b645-47036a7c2cdc', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4ee44e-684a-46ff-806c-a3ef2b7d3e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:18 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Volume volume-c8a68a84-b217-4a21-b645-47036a7c2cdc (c8a68a84-b217-4a21-b645-47036a7c2cdc): created successfully Sep 04 15:58:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4ee44e-684a-46ff-806c-a3ef2b7d3e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Flow 'volume_create_manager' (4fc9d1e3-eeda-4be9-8c32-a71f50f5c84a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:18 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-501d300c-aaa0-4933-a055-f1033c9eb6a2 tempest-VolumeQuotasAdminTestJSON-326845847 None] Created volume successfully. Sep 04 15:58:19 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-00f32e1c-5354-466d-85f8-ce51da1aec83 1073741824" returned: 0 in 0.523s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Flow 'volume_create_manager' (4d5e8eef-5835-4090-a9ce-8b924f4ebb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c852dac-6834-447d-9c76-50ba17f1f7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c852dac-6834-447d-9c76-50ba17f1f7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-759970789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b59af3-b320-4c9d-be6c-51c57d3b7d43,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7fbfa058a0a14903b4dda183aa7679f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:19Z,use_quota=True,user_id='8a5ba932c269489d82c66afe65aa7e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ac7f90c-bb08-4c8c-841e-eaefdc1b434b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ac7f90c-bb08-4c8c-841e-eaefdc1b434b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d430ea39-cae6-4fe6-8166-1685b4621c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d430ea39-cae6-4fe6-8166-1685b4621c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81b59af3-b320-4c9d-be6c-51c57d3b7d43', 'volume_name': 'volume-81b59af3-b320-4c9d-be6c-51c57d3b7d43', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (174b0f0c-7d62-499b-87ab-452fc8a375aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (174b0f0c-7d62-499b-87ab-452fc8a375aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f3c124-5135-446d-bc75-3b90e8eb6f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:19 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Volume 81b59af3-b320-4c9d-be6c-51c57d3b7d43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81b59af3-b320-4c9d-be6c-51c57d3b7d43', 'volume_size': 1} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-00f32e1c-5354-466d-85f8-ce51da1aec83 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:19 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-00f32e1c-5354-466d-85f8-ce51da1aec83 Sep 04 15:58:19 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:19 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-00f32e1c-5354-466d-85f8-ce51da1aec83" returned: 0 in 0.240s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.259s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-759970789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b59af3-b320-4c9d-be6c-51c57d3b7d43,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7fbfa058a0a14903b4dda183aa7679f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:19Z,use_quota=True,user_id='8a5ba932c269489d82c66afe65aa7e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Creating volume 81b59af3-b320-4c9d-be6c-51c57d3b7d43 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:58:19 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81b59af3-b320-4c9d-be6c-51c57d3b7d43 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89c3d194-fc9f-472b-8b4b-21e823d60676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00f32e1c-5354-466d-85f8-ce51da1aec83', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:19 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81b59af3-b320-4c9d-be6c-51c57d3b7d43 1073741824 Sep 04 15:58:19 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee1b7a5-cf76-4298-b597-9a1f47f09000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:19 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Volume volume-00f32e1c-5354-466d-85f8-ce51da1aec83 (00f32e1c-5354-466d-85f8-ce51da1aec83): created successfully Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee1b7a5-cf76-4298-b597-9a1f47f09000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Flow 'volume_create_manager' (68e20d43-09f4-4925-a75a-0868378fdefc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:19 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-d14e8896-4ea7-40ef-977a-21fe08b43466 tempest-VolumesActionsTest-524639293 None] Created volume successfully. Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c04ff3d6-1742-4db1-92d7-8758d10478df tempest-VolumesActionsTest-626533718 None] Acquiring lock "cinder-00f32e1c-5354-466d-85f8-ce51da1aec83-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c04ff3d6-1742-4db1-92d7-8758d10478df tempest-VolumesActionsTest-626533718 None] Lock "cinder-00f32e1c-5354-466d-85f8-ce51da1aec83-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c04ff3d6-1742-4db1-92d7-8758d10478df tempest-VolumesActionsTest-626533718 None] Acquiring lock "cinder-quobyte-00f32e1c-5354-466d-85f8-ce51da1aec83" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c04ff3d6-1742-4db1-92d7-8758d10478df tempest-VolumesActionsTest-626533718 None] Lock "cinder-quobyte-00f32e1c-5354-466d-85f8-ce51da1aec83" acquired by "delete_volume" :: waited 0.024s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:20 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[9078d551-977e-4992-98d3-e8fd02785dd4]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c04ff3d6-1742-4db1-92d7-8758d10478df tempest-VolumesActionsTest-626533718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-00f32e1c-5354-466d-85f8-ce51da1aec83 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:20 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81b59af3-b320-4c9d-be6c-51c57d3b7d43 1073741824" returned: 0 in 0.637s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81b59af3-b320-4c9d-be6c-51c57d3b7d43 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:20 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-00f32e1c-5354-466d-85f8-ce51da1aec83 Sep 04 15:58:20 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:20 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81b59af3-b320-4c9d-be6c-51c57d3b7d43 Sep 04 15:58:20 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:20 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81b59af3-b320-4c9d-be6c-51c57d3b7d43" returned: 0 in 0.263s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:20 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:58:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:20 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f3c124-5135-446d-bc75-3b90e8eb6f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81b59af3-b320-4c9d-be6c-51c57d3b7d43', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:20 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:20 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd94804-25f0-46a4-a60f-c74254aab3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c04ff3d6-1742-4db1-92d7-8758d10478df tempest-VolumesActionsTest-626533718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-00f32e1c-5354-466d-85f8-ce51da1aec83" returned: 0 in 0.405s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c04ff3d6-1742-4db1-92d7-8758d10478df tempest-VolumesActionsTest-626533718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-00f32e1c-5354-466d-85f8-ce51da1aec83 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:20 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Volume volume-81b59af3-b320-4c9d-be6c-51c57d3b7d43 (81b59af3-b320-4c9d-be6c-51c57d3b7d43): created successfully Sep 04 15:58:20 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd94804-25f0-46a4-a60f-c74254aab3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:20 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-00f32e1c-5354-466d-85f8-ce51da1aec83 Sep 04 15:58:20 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Flow 'volume_create_manager' (4d5e8eef-5835-4090-a9ce-8b924f4ebb51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:20 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:20 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-a2104446-011d-48a9-b65e-6c745291052e tempest-VolumesListTestJSON-141598411 None] Created volume successfully. Sep 04 15:58:20 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-4a8dc169-2540-4eee-8ddf-e368cac85880 tempest-VolumeQuotasAdminTestJSON-1914886403 None] Transfer volume completed successfully. Sep 04 15:58:20 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c04ff3d6-1742-4db1-92d7-8758d10478df tempest-VolumesActionsTest-626533718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-00f32e1c-5354-466d-85f8-ce51da1aec83" returned: 0 in 0.282s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:20 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c04ff3d6-1742-4db1-92d7-8758d10478df tempest-VolumesActionsTest-626533718 None] Lock "cinder-quobyte-00f32e1c-5354-466d-85f8-ce51da1aec83" released by "delete_volume" :: held 0.736s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:20 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-c04ff3d6-1742-4db1-92d7-8758d10478df tempest-VolumesActionsTest-626533718 None] Created reservations ['32e82204-e6e2-4464-b6ec-d4d275b861b8', '4bd8c6cc-4093-42bb-b152-fc4271ee36f4', 'ed0fc76c-a5f6-4d8e-8ec2-ffda836c032c', '08bd40e6-a26b-4ed8-96d9-2c241a6a6020'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:58:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c04ff3d6-1742-4db1-92d7-8758d10478df tempest-VolumesActionsTest-626533718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c04ff3d6-1742-4db1-92d7-8758d10478df tempest-VolumesActionsTest-626533718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:20 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c04ff3d6-1742-4db1-92d7-8758d10478df tempest-VolumesActionsTest-626533718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:20 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c04ff3d6-1742-4db1-92d7-8758d10478df tempest-VolumesActionsTest-626533718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c04ff3d6-1742-4db1-92d7-8758d10478df tempest-VolumesActionsTest-626533718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c04ff3d6-1742-4db1-92d7-8758d10478df tempest-VolumesActionsTest-626533718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:21 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:58:21 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:21 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-065b9083-160b-41f6-bdb4-d0633ca2f176 tempest-VolumeQuotasAdminTestJSON-1995075048 None] Acquiring lock "cinder-c8a68a84-b217-4a21-b645-47036a7c2cdc-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c04ff3d6-1742-4db1-92d7-8758d10478df tempest-VolumesActionsTest-626533718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.348s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-c04ff3d6-1742-4db1-92d7-8758d10478df tempest-VolumesActionsTest-626533718 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:58:21 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-c04ff3d6-1742-4db1-92d7-8758d10478df tempest-VolumesActionsTest-626533718 None] Deleted volume successfully. Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-065b9083-160b-41f6-bdb4-d0633ca2f176 tempest-VolumeQuotasAdminTestJSON-1995075048 None] Lock "cinder-c8a68a84-b217-4a21-b645-47036a7c2cdc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c04ff3d6-1742-4db1-92d7-8758d10478df tempest-VolumesActionsTest-626533718 None] Lock "cinder-00f32e1c-5354-466d-85f8-ce51da1aec83-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-065b9083-160b-41f6-bdb4-d0633ca2f176 tempest-VolumeQuotasAdminTestJSON-1995075048 None] Acquiring lock "cinder-quobyte-c8a68a84-b217-4a21-b645-47036a7c2cdc" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-065b9083-160b-41f6-bdb4-d0633ca2f176 tempest-VolumeQuotasAdminTestJSON-1995075048 None] Lock "cinder-quobyte-c8a68a84-b217-4a21-b645-47036a7c2cdc" acquired by "delete_volume" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf6e3ce-e53b-4ad3-82fc-9434753f8a35]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-065b9083-160b-41f6-bdb4-d0633ca2f176 tempest-VolumeQuotasAdminTestJSON-1995075048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c8a68a84-b217-4a21-b645-47036a7c2cdc {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:21 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c8a68a84-b217-4a21-b645-47036a7c2cdc Sep 04 15:58:21 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Flow 'volume_create_manager' (646615ec-cc4f-4a36-916f-b31507cb196f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd9fe44-dde7-425a-a707-10ad1aadef44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd9fe44-dde7-425a-a707-10ad1aadef44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1035001832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=708958e8-29f7-40a7-80a6-d18b04f44294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a9a976d6d44d17bbfdb01837ee3a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:22Z,use_quota=True,user_id='c64105a263944a91bc1166cf17d57624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a5bd43-a712-459e-9662-242ef23bbee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a5bd43-a712-459e-9662-242ef23bbee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297208dc-c282-47d1-a461-145de4b1969c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297208dc-c282-47d1-a461-145de4b1969c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '708958e8-29f7-40a7-80a6-d18b04f44294', 'volume_name': 'volume-708958e8-29f7-40a7-80a6-d18b04f44294', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b34c6e60-1c84-460c-9969-551592c061d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b34c6e60-1c84-460c-9969-551592c061d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93a622c-fa72-4c50-a500-a861aad0fdff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:21 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Volume 708958e8-29f7-40a7-80a6-d18b04f44294: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-708958e8-29f7-40a7-80a6-d18b04f44294', 'volume_size': 1} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1035001832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=708958e8-29f7-40a7-80a6-d18b04f44294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a9a976d6d44d17bbfdb01837ee3a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:22Z,use_quota=True,user_id='c64105a263944a91bc1166cf17d57624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Creating volume 708958e8-29f7-40a7-80a6-d18b04f44294 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:58:21 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-708958e8-29f7-40a7-80a6-d18b04f44294 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:21 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-065b9083-160b-41f6-bdb4-d0633ca2f176 tempest-VolumeQuotasAdminTestJSON-1995075048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c8a68a84-b217-4a21-b645-47036a7c2cdc" returned: 0 in 0.485s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-065b9083-160b-41f6-bdb4-d0633ca2f176 tempest-VolumeQuotasAdminTestJSON-1995075048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c8a68a84-b217-4a21-b645-47036a7c2cdc {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:21 devstack sudo[99085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-708958e8-29f7-40a7-80a6-d18b04f44294 1073741824 Sep 04 15:58:21 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:21 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c8a68a84-b217-4a21-b645-47036a7c2cdc Sep 04 15:58:21 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Flow 'volume_create_manager' (eeb52c28-7e8f-4572-a6e8-168ecdbc5b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b73b6f0-1e9a-48ee-9e4b-2ccd7e455027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b73b6f0-1e9a-48ee-9e4b-2ccd7e455027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-236173450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5905e72-4188-462e-b4ff-03af29063dc2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7fbfa058a0a14903b4dda183aa7679f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:22Z,use_quota=True,user_id='8a5ba932c269489d82c66afe65aa7e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866a04d3-78bd-4067-a0cb-fa3bec1bda54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:22 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866a04d3-78bd-4067-a0cb-fa3bec1bda54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc7196b-c87e-49a3-a0af-6dd7937ff1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc7196b-c87e-49a3-a0af-6dd7937ff1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5905e72-4188-462e-b4ff-03af29063dc2', 'volume_name': 'volume-c5905e72-4188-462e-b4ff-03af29063dc2', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (004185fe-f63b-46a3-b68f-65def0beed1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (004185fe-f63b-46a3-b68f-65def0beed1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f70605-6eb5-474d-969c-77b254080c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:22 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Volume c5905e72-4188-462e-b4ff-03af29063dc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5905e72-4188-462e-b4ff-03af29063dc2', 'volume_size': 1} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-065b9083-160b-41f6-bdb4-d0633ca2f176 tempest-VolumeQuotasAdminTestJSON-1995075048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c8a68a84-b217-4a21-b645-47036a7c2cdc" returned: 0 in 0.409s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-065b9083-160b-41f6-bdb4-d0633ca2f176 tempest-VolumeQuotasAdminTestJSON-1995075048 None] Lock "cinder-quobyte-c8a68a84-b217-4a21-b645-47036a7c2cdc" released by "delete_volume" :: held 0.944s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-065b9083-160b-41f6-bdb4-d0633ca2f176 tempest-VolumeQuotasAdminTestJSON-1995075048 None] Created reservations ['765744d5-8059-46b3-8db0-ff5356f37b55', 'f961983c-76b3-47a4-9a64-ccd4269422b2', 'd0707fa2-e29b-40b0-a9ca-451c5ce9a200', '2152eb30-b711-49a4-b192-d5e911611769'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:58:22 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-708958e8-29f7-40a7-80a6-d18b04f44294 1073741824" returned: 0 in 0.549s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-065b9083-160b-41f6-bdb4-d0633ca2f176 tempest-VolumeQuotasAdminTestJSON-1995075048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-065b9083-160b-41f6-bdb4-d0633ca2f176 tempest-VolumeQuotasAdminTestJSON-1995075048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-065b9083-160b-41f6-bdb4-d0633ca2f176 tempest-VolumeQuotasAdminTestJSON-1995075048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-065b9083-160b-41f6-bdb4-d0633ca2f176 tempest-VolumeQuotasAdminTestJSON-1995075048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-065b9083-160b-41f6-bdb4-d0633ca2f176 tempest-VolumeQuotasAdminTestJSON-1995075048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-065b9083-160b-41f6-bdb4-d0633ca2f176 tempest-VolumeQuotasAdminTestJSON-1995075048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-708958e8-29f7-40a7-80a6-d18b04f44294 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:22 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:58:22 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:22 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-708958e8-29f7-40a7-80a6-d18b04f44294 Sep 04 15:58:22 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:22 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-065b9083-160b-41f6-bdb4-d0633ca2f176 tempest-VolumeQuotasAdminTestJSON-1995075048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.291s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-065b9083-160b-41f6-bdb4-d0633ca2f176 tempest-VolumeQuotasAdminTestJSON-1995075048 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:58:22 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-708958e8-29f7-40a7-80a6-d18b04f44294" returned: 0 in 0.292s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:22 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-065b9083-160b-41f6-bdb4-d0633ca2f176 tempest-VolumeQuotasAdminTestJSON-1995075048 None] Deleted volume successfully. Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.474s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-236173450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5905e72-4188-462e-b4ff-03af29063dc2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7fbfa058a0a14903b4dda183aa7679f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:22Z,use_quota=True,user_id='8a5ba932c269489d82c66afe65aa7e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Creating volume c5905e72-4188-462e-b4ff-03af29063dc2 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:58:22 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c5905e72-4188-462e-b4ff-03af29063dc2 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93a622c-fa72-4c50-a500-a861aad0fdff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-708958e8-29f7-40a7-80a6-d18b04f44294', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f2c0a39-8018-45a0-ac81-6a7c78e7cfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:22 devstack sudo[99102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c5905e72-4188-462e-b4ff-03af29063dc2 1073741824 Sep 04 15:58:22 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-065b9083-160b-41f6-bdb4-d0633ca2f176 tempest-VolumeQuotasAdminTestJSON-1995075048 None] Lock "cinder-c8a68a84-b217-4a21-b645-47036a7c2cdc-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:22 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Volume volume-708958e8-29f7-40a7-80a6-d18b04f44294 (708958e8-29f7-40a7-80a6-d18b04f44294): created successfully Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f2c0a39-8018-45a0-ac81-6a7c78e7cfc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Flow 'volume_create_manager' (646615ec-cc4f-4a36-916f-b31507cb196f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:23 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-8407edbc-feaa-4242-86da-27a13a99b4c8 tempest-VolumesActionsTest-524639293 None] Created volume successfully. Sep 04 15:58:23 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c5905e72-4188-462e-b4ff-03af29063dc2 1073741824" returned: 0 in 0.494s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c5905e72-4188-462e-b4ff-03af29063dc2 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:23 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c5905e72-4188-462e-b4ff-03af29063dc2 Sep 04 15:58:23 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:23 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c5905e72-4188-462e-b4ff-03af29063dc2" returned: 0 in 0.263s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:23 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:58:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f70605-6eb5-474d-969c-77b254080c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5905e72-4188-462e-b4ff-03af29063dc2', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34f7c5ed-fa86-4bcc-a891-3265ad1669f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:23 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Volume volume-c5905e72-4188-462e-b4ff-03af29063dc2 (c5905e72-4188-462e-b4ff-03af29063dc2): created successfully Sep 04 15:58:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34f7c5ed-fa86-4bcc-a891-3265ad1669f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Flow 'volume_create_manager' (eeb52c28-7e8f-4572-a6e8-168ecdbc5b2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:23 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-596b56ec-7005-49e7-80b4-d13fa2f5efb3 tempest-VolumesListTestJSON-141598411 None] Created volume successfully. Sep 04 15:58:24 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-264cd356-4de2-4576-a718-5fabff33f4bf tempest-VolumesActionsTest-524639293 None] Acquiring lock "cinder-708958e8-29f7-40a7-80a6-d18b04f44294-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:24 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-264cd356-4de2-4576-a718-5fabff33f4bf tempest-VolumesActionsTest-524639293 None] Lock "cinder-708958e8-29f7-40a7-80a6-d18b04f44294-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:24 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-264cd356-4de2-4576-a718-5fabff33f4bf tempest-VolumesActionsTest-524639293 None] Acquiring lock "cinder-quobyte-708958e8-29f7-40a7-80a6-d18b04f44294" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:24 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-264cd356-4de2-4576-a718-5fabff33f4bf tempest-VolumesActionsTest-524639293 None] Lock "cinder-quobyte-708958e8-29f7-40a7-80a6-d18b04f44294" acquired by "delete_volume" :: waited 0.023s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:24 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[532ce257-2a18-44e9-9870-4564aa224e0e]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-264cd356-4de2-4576-a718-5fabff33f4bf tempest-VolumesActionsTest-524639293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-708958e8-29f7-40a7-80a6-d18b04f44294 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:24 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-708958e8-29f7-40a7-80a6-d18b04f44294 Sep 04 15:58:24 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:24 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:58:24 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Flow 'volume_create_manager' (c9df234b-a52d-487c-9c2b-b1646f062b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:24 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384fa9ba-192a-4bed-b576-8c5a5adfa091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:24 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384fa9ba-192a-4bed-b576-8c5a5adfa091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1540059337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409f80a4-17b0-42b6-9f86-f41a14ac9711,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7fbfa058a0a14903b4dda183aa7679f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:25Z,use_quota=True,user_id='8a5ba932c269489d82c66afe65aa7e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:24 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9976bfc-9a37-42ef-a4bb-10b4b070f645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:24 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9976bfc-9a37-42ef-a4bb-10b4b070f645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:24 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96970b7a-0de2-42ce-9ff4-71176eb43201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:24 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96970b7a-0de2-42ce-9ff4-71176eb43201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '409f80a4-17b0-42b6-9f86-f41a14ac9711', 'volume_name': 'volume-409f80a4-17b0-42b6-9f86-f41a14ac9711', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:24 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be10aa7-afd1-4274-8a86-d967dabdf1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:24 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be10aa7-afd1-4274-8a86-d967dabdf1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22415d7d-17a6-466e-9a57-526c76c220e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:25 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Volume 409f80a4-17b0-42b6-9f86-f41a14ac9711: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-409f80a4-17b0-42b6-9f86-f41a14ac9711', 'volume_size': 1} Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1540059337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409f80a4-17b0-42b6-9f86-f41a14ac9711,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7fbfa058a0a14903b4dda183aa7679f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:25Z,use_quota=True,user_id='8a5ba932c269489d82c66afe65aa7e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Creating volume 409f80a4-17b0-42b6-9f86-f41a14ac9711 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:25 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:58:25 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-409f80a4-17b0-42b6-9f86-f41a14ac9711 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-264cd356-4de2-4576-a718-5fabff33f4bf tempest-VolumesActionsTest-524639293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-708958e8-29f7-40a7-80a6-d18b04f44294" returned: 0 in 0.440s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-264cd356-4de2-4576-a718-5fabff33f4bf tempest-VolumesActionsTest-524639293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-708958e8-29f7-40a7-80a6-d18b04f44294 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:25 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-409f80a4-17b0-42b6-9f86-f41a14ac9711 1073741824 Sep 04 15:58:25 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:25 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-708958e8-29f7-40a7-80a6-d18b04f44294 Sep 04 15:58:25 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:25 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-264cd356-4de2-4576-a718-5fabff33f4bf tempest-VolumesActionsTest-524639293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-708958e8-29f7-40a7-80a6-d18b04f44294" returned: 0 in 0.258s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-264cd356-4de2-4576-a718-5fabff33f4bf tempest-VolumesActionsTest-524639293 None] Lock "cinder-quobyte-708958e8-29f7-40a7-80a6-d18b04f44294" released by "delete_volume" :: held 0.742s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-264cd356-4de2-4576-a718-5fabff33f4bf tempest-VolumesActionsTest-524639293 None] Created reservations ['78250426-7eaa-4106-8a84-f5fc94f247f6', 'd29be303-a265-4f24-810f-dea8122eedf1', 'eb0161c3-dd4a-4d80-a47b-3cbab9aa7ba4', '40f7edba-48cb-41a8-9533-3f9ecba7eb83'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-264cd356-4de2-4576-a718-5fabff33f4bf tempest-VolumesActionsTest-524639293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-264cd356-4de2-4576-a718-5fabff33f4bf tempest-VolumesActionsTest-524639293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-264cd356-4de2-4576-a718-5fabff33f4bf tempest-VolumesActionsTest-524639293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-264cd356-4de2-4576-a718-5fabff33f4bf tempest-VolumesActionsTest-524639293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-264cd356-4de2-4576-a718-5fabff33f4bf tempest-VolumesActionsTest-524639293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-264cd356-4de2-4576-a718-5fabff33f4bf tempest-VolumesActionsTest-524639293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:25 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:58:25 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:25 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-409f80a4-17b0-42b6-9f86-f41a14ac9711 1073741824" returned: 0 in 0.621s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-409f80a4-17b0-42b6-9f86-f41a14ac9711 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:25 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-409f80a4-17b0-42b6-9f86-f41a14ac9711 Sep 04 15:58:25 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:25 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-264cd356-4de2-4576-a718-5fabff33f4bf tempest-VolumesActionsTest-524639293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.387s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-264cd356-4de2-4576-a718-5fabff33f4bf tempest-VolumesActionsTest-524639293 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:58:25 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-264cd356-4de2-4576-a718-5fabff33f4bf tempest-VolumesActionsTest-524639293 None] Deleted volume successfully. Sep 04 15:58:25 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-264cd356-4de2-4576-a718-5fabff33f4bf tempest-VolumesActionsTest-524639293 None] Lock "cinder-708958e8-29f7-40a7-80a6-d18b04f44294-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:26 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-409f80a4-17b0-42b6-9f86-f41a14ac9711" returned: 0 in 0.397s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:26 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:58:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22415d7d-17a6-466e-9a57-526c76c220e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-409f80a4-17b0-42b6-9f86-f41a14ac9711', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (919cd4b3-7129-49c8-b954-d6bd0799dbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:26 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Volume volume-409f80a4-17b0-42b6-9f86-f41a14ac9711 (409f80a4-17b0-42b6-9f86-f41a14ac9711): created successfully Sep 04 15:58:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (919cd4b3-7129-49c8-b954-d6bd0799dbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Flow 'volume_create_manager' (c9df234b-a52d-487c-9c2b-b1646f062b0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:26 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-69dd45ae-11cc-40c5-96a3-f6d88f94f54e tempest-VolumesListTestJSON-141598411 None] Created volume successfully. Sep 04 15:58:29 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-90e0904a-6a5b-4759-883d-4adeeb4e621b tempest-VolumesListTestJSON-141598411 None] Acquiring lock "cinder-409f80a4-17b0-42b6-9f86-f41a14ac9711-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:29 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-90e0904a-6a5b-4759-883d-4adeeb4e621b tempest-VolumesListTestJSON-141598411 None] Lock "cinder-409f80a4-17b0-42b6-9f86-f41a14ac9711-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:29 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-90e0904a-6a5b-4759-883d-4adeeb4e621b tempest-VolumesListTestJSON-141598411 None] Acquiring lock "cinder-quobyte-409f80a4-17b0-42b6-9f86-f41a14ac9711" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:29 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-90e0904a-6a5b-4759-883d-4adeeb4e621b tempest-VolumesListTestJSON-141598411 None] Lock "cinder-quobyte-409f80a4-17b0-42b6-9f86-f41a14ac9711" acquired by "delete_volume" :: waited 0.030s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:30 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[8565ac67-7986-442f-b8bc-5457c010c734]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-90e0904a-6a5b-4759-883d-4adeeb4e621b tempest-VolumesListTestJSON-141598411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-409f80a4-17b0-42b6-9f86-f41a14ac9711 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:30 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-409f80a4-17b0-42b6-9f86-f41a14ac9711 Sep 04 15:58:30 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:30 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-90e0904a-6a5b-4759-883d-4adeeb4e621b tempest-VolumesListTestJSON-141598411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-409f80a4-17b0-42b6-9f86-f41a14ac9711" returned: 0 in 0.391s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-90e0904a-6a5b-4759-883d-4adeeb4e621b tempest-VolumesListTestJSON-141598411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-409f80a4-17b0-42b6-9f86-f41a14ac9711 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:30 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-409f80a4-17b0-42b6-9f86-f41a14ac9711 Sep 04 15:58:30 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:30 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-90e0904a-6a5b-4759-883d-4adeeb4e621b tempest-VolumesListTestJSON-141598411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-409f80a4-17b0-42b6-9f86-f41a14ac9711" returned: 0 in 0.264s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:30 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-90e0904a-6a5b-4759-883d-4adeeb4e621b tempest-VolumesListTestJSON-141598411 None] Lock "cinder-quobyte-409f80a4-17b0-42b6-9f86-f41a14ac9711" released by "delete_volume" :: held 0.703s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:30 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=154,cinder:INSERT=53,cinder:UPDATE=203,cinder:DELETE=14 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:58:30 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=167,cinder:INSERT=64,cinder:UPDATE=197,cinder:DELETE=19 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:58:30 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-90e0904a-6a5b-4759-883d-4adeeb4e621b tempest-VolumesListTestJSON-141598411 None] Created reservations ['c149a7e3-52a3-40ef-988b-2eec6bf379a6', '35bf52f4-8553-47c0-84e8-1a4c60ab9b84', 'fde31d15-a439-4cd4-a12f-2212d56efbe1', '39747ed1-7753-4b65-aca1-36628275a97b'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:58:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-90e0904a-6a5b-4759-883d-4adeeb4e621b tempest-VolumesListTestJSON-141598411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-90e0904a-6a5b-4759-883d-4adeeb4e621b tempest-VolumesListTestJSON-141598411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:30 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-90e0904a-6a5b-4759-883d-4adeeb4e621b tempest-VolumesListTestJSON-141598411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:30 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-90e0904a-6a5b-4759-883d-4adeeb4e621b tempest-VolumesListTestJSON-141598411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-90e0904a-6a5b-4759-883d-4adeeb4e621b tempest-VolumesListTestJSON-141598411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-90e0904a-6a5b-4759-883d-4adeeb4e621b tempest-VolumesListTestJSON-141598411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:30 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:58:30 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-57c5b6d7-618b-4a3b-bcc0-9b938da3582c tempest-VolumesListTestJSON-141598411 None] Acquiring lock "cinder-c5905e72-4188-462e-b4ff-03af29063dc2-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-57c5b6d7-618b-4a3b-bcc0-9b938da3582c tempest-VolumesListTestJSON-141598411 None] Lock "cinder-c5905e72-4188-462e-b4ff-03af29063dc2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-57c5b6d7-618b-4a3b-bcc0-9b938da3582c tempest-VolumesListTestJSON-141598411 None] Acquiring lock "cinder-quobyte-c5905e72-4188-462e-b4ff-03af29063dc2" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:31 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-57c5b6d7-618b-4a3b-bcc0-9b938da3582c tempest-VolumesListTestJSON-141598411 None] Lock "cinder-quobyte-c5905e72-4188-462e-b4ff-03af29063dc2" acquired by "delete_volume" :: waited 0.019s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-90e0904a-6a5b-4759-883d-4adeeb4e621b tempest-VolumesListTestJSON-141598411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.420s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-90e0904a-6a5b-4759-883d-4adeeb4e621b tempest-VolumesListTestJSON-141598411 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:58:31 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-90e0904a-6a5b-4759-883d-4adeeb4e621b tempest-VolumesListTestJSON-141598411 None] Deleted volume successfully. Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4c0279-760e-445e-b3b4-6eb6f521c2b4]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-57c5b6d7-618b-4a3b-bcc0-9b938da3582c tempest-VolumesListTestJSON-141598411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c5905e72-4188-462e-b4ff-03af29063dc2 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-90e0904a-6a5b-4759-883d-4adeeb4e621b tempest-VolumesListTestJSON-141598411 None] Lock "cinder-409f80a4-17b0-42b6-9f86-f41a14ac9711-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:31 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c5905e72-4188-462e-b4ff-03af29063dc2 Sep 04 15:58:31 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Flow 'volume_create_manager' (e8f4265a-b4ae-4f39-a857-d14d54f778e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6652fa74-8345-4a45-b541-3a9381fc4365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6652fa74-8345-4a45-b541-3a9381fc4365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-261585606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e401ef7-bdec-40dc-b499-5e9cad8b0278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ce3dc2dd3284c4fb9614a75eba09329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:32Z,use_quota=True,user_id='cdaa9cbabd524c33b9b079126bf55d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7686cc20-6596-4c7e-bab9-4256c3229357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7686cc20-6596-4c7e-bab9-4256c3229357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4207a69-fe3c-4ff7-a688-6a3f0dc6b1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4207a69-fe3c-4ff7-a688-6a3f0dc6b1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e401ef7-bdec-40dc-b499-5e9cad8b0278', 'volume_name': 'volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e1129f-85d5-4cb7-833b-f653a9205540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e1129f-85d5-4cb7-833b-f653a9205540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f962c763-8abe-4014-a4c5-77bdfcbc34a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:31 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Volume 4e401ef7-bdec-40dc-b499-5e9cad8b0278: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278', 'volume_size': 1} Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-261585606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e401ef7-bdec-40dc-b499-5e9cad8b0278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ce3dc2dd3284c4fb9614a75eba09329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:32Z,use_quota=True,user_id='cdaa9cbabd524c33b9b079126bf55d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Creating volume 4e401ef7-bdec-40dc-b499-5e9cad8b0278 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:58:31 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:31 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-57c5b6d7-618b-4a3b-bcc0-9b938da3582c tempest-VolumesListTestJSON-141598411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c5905e72-4188-462e-b4ff-03af29063dc2" returned: 0 in 0.425s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-57c5b6d7-618b-4a3b-bcc0-9b938da3582c tempest-VolumesListTestJSON-141598411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c5905e72-4188-462e-b4ff-03af29063dc2 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:31 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278 1073741824 Sep 04 15:58:31 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:31 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c5905e72-4188-462e-b4ff-03af29063dc2 Sep 04 15:58:31 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:32 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-57c5b6d7-618b-4a3b-bcc0-9b938da3582c tempest-VolumesListTestJSON-141598411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c5905e72-4188-462e-b4ff-03af29063dc2" returned: 0 in 0.284s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-57c5b6d7-618b-4a3b-bcc0-9b938da3582c tempest-VolumesListTestJSON-141598411 None] Lock "cinder-quobyte-c5905e72-4188-462e-b4ff-03af29063dc2" released by "delete_volume" :: held 0.763s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:32 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-57c5b6d7-618b-4a3b-bcc0-9b938da3582c tempest-VolumesListTestJSON-141598411 None] Created reservations ['0a884615-8f6b-40bd-902f-b50afb4e65a0', '17a148e2-4d81-47e2-8c2f-8f2999e57aff', '757ccc53-a84c-403c-b90a-53f5f55a9207', 'a564b87b-f9d7-47d6-a351-dce4f43898af'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:58:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-57c5b6d7-618b-4a3b-bcc0-9b938da3582c tempest-VolumesListTestJSON-141598411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-57c5b6d7-618b-4a3b-bcc0-9b938da3582c tempest-VolumesListTestJSON-141598411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-57c5b6d7-618b-4a3b-bcc0-9b938da3582c tempest-VolumesListTestJSON-141598411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-57c5b6d7-618b-4a3b-bcc0-9b938da3582c tempest-VolumesListTestJSON-141598411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-57c5b6d7-618b-4a3b-bcc0-9b938da3582c tempest-VolumesListTestJSON-141598411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-57c5b6d7-618b-4a3b-bcc0-9b938da3582c tempest-VolumesListTestJSON-141598411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:32 devstack sudo[99197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:58:32 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:32 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278 1073741824" returned: 0 in 0.552s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:32 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278 Sep 04 15:58:32 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7a22a5f3-abc2-4c61-a28b-aa637b8695b6 tempest-VolumesListTestJSON-141598411 None] Acquiring lock "cinder-81b59af3-b320-4c9d-be6c-51c57d3b7d43-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:32 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-57c5b6d7-618b-4a3b-bcc0-9b938da3582c tempest-VolumesListTestJSON-141598411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.275s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:32 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-57c5b6d7-618b-4a3b-bcc0-9b938da3582c tempest-VolumesListTestJSON-141598411 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:58:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7a22a5f3-abc2-4c61-a28b-aa637b8695b6 tempest-VolumesListTestJSON-141598411 None] Lock "cinder-81b59af3-b320-4c9d-be6c-51c57d3b7d43-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:32 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-57c5b6d7-618b-4a3b-bcc0-9b938da3582c tempest-VolumesListTestJSON-141598411 None] Deleted volume successfully. Sep 04 15:58:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-57c5b6d7-618b-4a3b-bcc0-9b938da3582c tempest-VolumesListTestJSON-141598411 None] Lock "cinder-c5905e72-4188-462e-b4ff-03af29063dc2-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7a22a5f3-abc2-4c61-a28b-aa637b8695b6 tempest-VolumesListTestJSON-141598411 None] Acquiring lock "cinder-quobyte-81b59af3-b320-4c9d-be6c-51c57d3b7d43" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7a22a5f3-abc2-4c61-a28b-aa637b8695b6 tempest-VolumesListTestJSON-141598411 None] Lock "cinder-quobyte-81b59af3-b320-4c9d-be6c-51c57d3b7d43" acquired by "delete_volume" :: waited 0.019s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:32 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34d8181-1008-445d-9e68-692b8ec334a0]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7a22a5f3-abc2-4c61-a28b-aa637b8695b6 tempest-VolumesListTestJSON-141598411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81b59af3-b320-4c9d-be6c-51c57d3b7d43 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:32 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278" returned: 0 in 0.315s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:58:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f962c763-8abe-4014-a4c5-77bdfcbc34a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef63f828-7534-4ccf-941e-be779f103feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:32 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Volume volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278 (4e401ef7-bdec-40dc-b499-5e9cad8b0278): created successfully Sep 04 15:58:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef63f828-7534-4ccf-941e-be779f103feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Flow 'volume_create_manager' (e8f4265a-b4ae-4f39-a857-d14d54f778e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:32 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-a48c6c17-8d89-44ab-bbd2-b4c131d542dc tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Created volume successfully. Sep 04 15:58:32 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81b59af3-b320-4c9d-be6c-51c57d3b7d43 Sep 04 15:58:32 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:33 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7a22a5f3-abc2-4c61-a28b-aa637b8695b6 tempest-VolumesListTestJSON-141598411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81b59af3-b320-4c9d-be6c-51c57d3b7d43" returned: 0 in 0.432s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7a22a5f3-abc2-4c61-a28b-aa637b8695b6 tempest-VolumesListTestJSON-141598411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81b59af3-b320-4c9d-be6c-51c57d3b7d43 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:33 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81b59af3-b320-4c9d-be6c-51c57d3b7d43 Sep 04 15:58:33 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:33 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7a22a5f3-abc2-4c61-a28b-aa637b8695b6 tempest-VolumesListTestJSON-141598411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81b59af3-b320-4c9d-be6c-51c57d3b7d43" returned: 0 in 0.240s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:33 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7a22a5f3-abc2-4c61-a28b-aa637b8695b6 tempest-VolumesListTestJSON-141598411 None] Lock "cinder-quobyte-81b59af3-b320-4c9d-be6c-51c57d3b7d43" released by "delete_volume" :: held 0.717s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:33 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-7a22a5f3-abc2-4c61-a28b-aa637b8695b6 tempest-VolumesListTestJSON-141598411 None] Created reservations ['3021b3cf-7da4-465f-a54d-90b6addc275b', 'e7ea3062-49ea-4152-b5eb-02d2e1b873ae', 'efc181c2-8b65-4c7e-8480-1bce57d08e8a', '2ce52391-3198-47b7-a6f6-f55cef3905e0'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:58:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7a22a5f3-abc2-4c61-a28b-aa637b8695b6 tempest-VolumesListTestJSON-141598411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7a22a5f3-abc2-4c61-a28b-aa637b8695b6 tempest-VolumesListTestJSON-141598411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:33 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7a22a5f3-abc2-4c61-a28b-aa637b8695b6 tempest-VolumesListTestJSON-141598411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:33 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7a22a5f3-abc2-4c61-a28b-aa637b8695b6 tempest-VolumesListTestJSON-141598411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7a22a5f3-abc2-4c61-a28b-aa637b8695b6 tempest-VolumesListTestJSON-141598411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7a22a5f3-abc2-4c61-a28b-aa637b8695b6 tempest-VolumesListTestJSON-141598411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:33 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:58:33 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:33 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7a22a5f3-abc2-4c61-a28b-aa637b8695b6 tempest-VolumesListTestJSON-141598411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.236s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:33 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-7a22a5f3-abc2-4c61-a28b-aa637b8695b6 tempest-VolumesListTestJSON-141598411 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:58:33 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-7a22a5f3-abc2-4c61-a28b-aa637b8695b6 tempest-VolumesListTestJSON-141598411 None] Deleted volume successfully. Sep 04 15:58:33 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7a22a5f3-abc2-4c61-a28b-aa637b8695b6 tempest-VolumesListTestJSON-141598411 None] Lock "cinder-81b59af3-b320-4c9d-be6c-51c57d3b7d43-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-456196a5-5bc6-4e09-8626-12319cf812aa tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-456196a5-5bc6-4e09-8626-12319cf812aa tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-456196a5-5bc6-4e09-8626-12319cf812aa tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Creating offline snapshot 7dbe72c7-cf6f-4b07-870f-b240c34f97d9 of volume 4e401ef7-bdec-40dc-b499-5e9cad8b0278 {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:58:34 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc72f30-8544-4552-8a13-13b52238adc5]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-456196a5-5bc6-4e09-8626-12319cf812aa tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:34 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278 Sep 04 15:58:34 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:34 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-456196a5-5bc6-4e09-8626-12319cf812aa tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278" returned: 0 in 0.371s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-456196a5-5bc6-4e09-8626-12319cf812aa tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278.7dbe72c7-cf6f-4b07-870f-b240c34f97d9 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:34 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278.7dbe72c7-cf6f-4b07-870f-b240c34f97d9 1G Sep 04 15:58:34 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:34 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-456196a5-5bc6-4e09-8626-12319cf812aa tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278.7dbe72c7-cf6f-4b07-870f-b240c34f97d9 1G" returned: 0 in 0.446s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-456196a5-5bc6-4e09-8626-12319cf812aa tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278.7dbe72c7-cf6f-4b07-870f-b240c34f97d9 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:34 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278.7dbe72c7-cf6f-4b07-870f-b240c34f97d9 Sep 04 15:58:34 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:35 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-456196a5-5bc6-4e09-8626-12319cf812aa tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278.7dbe72c7-cf6f-4b07-870f-b240c34f97d9" returned: 0 in 0.499s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:35 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-456196a5-5bc6-4e09-8626-12319cf812aa tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278.7dbe72c7-cf6f-4b07-870f-b240c34f97d9 is being set with open permissions: ugo+rw Sep 04 15:58:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-456196a5-5bc6-4e09-8626-12319cf812aa tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278.7dbe72c7-cf6f-4b07-870f-b240c34f97d9 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:35 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278.7dbe72c7-cf6f-4b07-870f-b240c34f97d9 Sep 04 15:58:35 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:35 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-456196a5-5bc6-4e09-8626-12319cf812aa tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278.7dbe72c7-cf6f-4b07-870f-b240c34f97d9" returned: 0 in 0.284s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-456196a5-5bc6-4e09-8626-12319cf812aa tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:35 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278.info Sep 04 15:58:35 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:36 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-456196a5-5bc6-4e09-8626-12319cf812aa tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278.info" returned: 0 in 0.292s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:36 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-456196a5-5bc6-4e09-8626-12319cf812aa tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278.info is being set with open permissions: ugo+rw Sep 04 15:58:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-456196a5-5bc6-4e09-8626-12319cf812aa tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:36 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278.info Sep 04 15:58:36 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:36 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-456196a5-5bc6-4e09-8626-12319cf812aa tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278.info" returned: 0 in 0.315s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-456196a5-5bc6-4e09-8626-12319cf812aa tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.332s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:36 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-456196a5-5bc6-4e09-8626-12319cf812aa tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Create snapshot completed successfully Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Flow 'volume_create_manager' (25ee8953-1265-499e-9949-b12247e87aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0558149-b234-40ec-875a-c4a8d90fff52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0558149-b234-40ec-875a-c4a8d90fff52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-265538842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb1d197-3157-4a43-85a6-8c316aca9e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9539e0bbbfa463aab9f6d8e71013390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:37Z,use_quota=True,user_id='ffbd2cc3d52c4e33ac0cfa3ec8bd6c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (439f6fd2-c28d-4677-9cfc-85282be164c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (439f6fd2-c28d-4677-9cfc-85282be164c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd408493-4d4e-4907-a8b1-ee0f2ae63e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd408493-4d4e-4907-a8b1-ee0f2ae63e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eb1d197-3157-4a43-85a6-8c316aca9e5f', 'volume_name': 'volume-6eb1d197-3157-4a43-85a6-8c316aca9e5f', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe7a739f-493a-46dd-b444-46a4cc9d22f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe7a739f-493a-46dd-b444-46a4cc9d22f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4727b65d-d13c-4e4f-a012-c5530749e4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:37 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Volume 6eb1d197-3157-4a43-85a6-8c316aca9e5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eb1d197-3157-4a43-85a6-8c316aca9e5f', 'volume_size': 1} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-265538842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb1d197-3157-4a43-85a6-8c316aca9e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9539e0bbbfa463aab9f6d8e71013390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:37Z,use_quota=True,user_id='ffbd2cc3d52c4e33ac0cfa3ec8bd6c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Creating volume 6eb1d197-3157-4a43-85a6-8c316aca9e5f {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:58:37 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6eb1d197-3157-4a43-85a6-8c316aca9e5f 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:37 devstack sudo[99241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6eb1d197-3157-4a43-85a6-8c316aca9e5f 1073741824 Sep 04 15:58:37 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4e3f556d-df81-4a5f-a00f-77ee3300d2f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Acquiring lock "cinder-7dbe72c7-cf6f-4b07-870f-b240c34f97d9-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4e3f556d-df81-4a5f-a00f-77ee3300d2f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Lock "cinder-7dbe72c7-cf6f-4b07-870f-b240c34f97d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4e3f556d-df81-4a5f-a00f-77ee3300d2f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Acquiring lock "cinder-quobyte-4e401ef7-bdec-40dc-b499-5e9cad8b0278" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4e3f556d-df81-4a5f-a00f-77ee3300d2f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Lock "cinder-quobyte-4e401ef7-bdec-40dc-b499-5e9cad8b0278" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4e3f556d-df81-4a5f-a00f-77ee3300d2f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Acquiring lock "cinder-quobyte-7dbe72c7-cf6f-4b07-870f-b240c34f97d9" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:37 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4e3f556d-df81-4a5f-a00f-77ee3300d2f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Lock "cinder-quobyte-7dbe72c7-cf6f-4b07-870f-b240c34f97d9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-4e3f556d-df81-4a5f-a00f-77ee3300d2f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Deleting offline snapshot 7dbe72c7-cf6f-4b07-870f-b240c34f97d9 of volume 4e401ef7-bdec-40dc-b499-5e9cad8b0278 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-4e3f556d-df81-4a5f-a00f-77ee3300d2f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] snapshot_file for this snap is: volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278.7dbe72c7-cf6f-4b07-870f-b240c34f97d9 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6eb1d197-3157-4a43-85a6-8c316aca9e5f 1073741824" returned: 0 in 0.547s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[80da1826-ea18-49d4-b001-72316ccde036]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4e3f556d-df81-4a5f-a00f-77ee3300d2f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278.7dbe72c7-cf6f-4b07-870f-b240c34f97d9 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6eb1d197-3157-4a43-85a6-8c316aca9e5f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:37 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6eb1d197-3157-4a43-85a6-8c316aca9e5f Sep 04 15:58:37 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:37 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278.7dbe72c7-cf6f-4b07-870f-b240c34f97d9 Sep 04 15:58:37 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:38 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6eb1d197-3157-4a43-85a6-8c316aca9e5f" returned: 0 in 0.310s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:58:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4727b65d-d13c-4e4f-a012-c5530749e4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eb1d197-3157-4a43-85a6-8c316aca9e5f', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319d0a93-0c66-4385-b637-eb95886dbb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:38 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Volume volume-6eb1d197-3157-4a43-85a6-8c316aca9e5f (6eb1d197-3157-4a43-85a6-8c316aca9e5f): created successfully Sep 04 15:58:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319d0a93-0c66-4385-b637-eb95886dbb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Flow 'volume_create_manager' (25ee8953-1265-499e-9949-b12247e87aa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:38 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4e3f556d-df81-4a5f-a00f-77ee3300d2f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278.7dbe72c7-cf6f-4b07-870f-b240c34f97d9" returned: 0 in 0.409s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-4e3f556d-df81-4a5f-a00f-77ee3300d2f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:58:38 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-f9d709e5-cfdd-4109-a7b4-780161c5fcde tempest-VolumesNegativeTest-23707419 None] Created volume successfully. Sep 04 15:58:38 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[990e0391-5e5f-42a2-a635-1443622ad9da]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4e3f556d-df81-4a5f-a00f-77ee3300d2f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:58:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:38 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:58:38 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:38 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278 Sep 04 15:58:38 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:38 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.259s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:38 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:58:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager._thread_info {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:58:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread count: 28 {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:58:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread info: [<_MainThread(MainThread, started 138899118923904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:58:38 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4e3f556d-df81-4a5f-a00f-77ee3300d2f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278" returned: 0 in 0.388s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4e3f556d-df81-4a5f-a00f-77ee3300d2f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278.7dbe72c7-cf6f-4b07-870f-b240c34f97d9 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:38 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278.7dbe72c7-cf6f-4b07-870f-b240c34f97d9 Sep 04 15:58:38 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:38 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4e3f556d-df81-4a5f-a00f-77ee3300d2f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278.7dbe72c7-cf6f-4b07-870f-b240c34f97d9" returned: 0 in 0.345s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4e3f556d-df81-4a5f-a00f-77ee3300d2f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278.7dbe72c7-cf6f-4b07-870f-b240c34f97d9 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:38 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278.7dbe72c7-cf6f-4b07-870f-b240c34f97d9 Sep 04 15:58:38 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:39 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4e3f556d-df81-4a5f-a00f-77ee3300d2f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278.7dbe72c7-cf6f-4b07-870f-b240c34f97d9" returned: 0 in 0.244s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:39 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4e3f556d-df81-4a5f-a00f-77ee3300d2f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Lock "cinder-quobyte-7dbe72c7-cf6f-4b07-870f-b240c34f97d9" released by "_delete_snapshot" :: held 1.504s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:39 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4e3f556d-df81-4a5f-a00f-77ee3300d2f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Lock "cinder-quobyte-4e401ef7-bdec-40dc-b499-5e9cad8b0278" released by "delete_snapshot" :: held 1.533s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:39 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-4e3f556d-df81-4a5f-a00f-77ee3300d2f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Created reservations ['ef2a3ad3-4042-4021-9196-4c0445c0a00f', '839e8f09-a5e6-44ed-b49f-c006ee1a3d52', '20ace2b3-4f65-46a6-862d-c17846100bce', 'c6a67563-e0d3-47b5-8b50-f5d23ba12dd1'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:58:39 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-4e3f556d-df81-4a5f-a00f-77ee3300d2f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Delete snapshot completed successfully. Sep 04 15:58:39 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4e3f556d-df81-4a5f-a00f-77ee3300d2f1 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Lock "cinder-7dbe72c7-cf6f-4b07-870f-b240c34f97d9-delete_snapshot" released by "delete_snapshot" :: held 1.695s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:39 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cd3f5905-f18a-4bd7-9683-359cd77c6579 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Acquiring lock "cinder-4e401ef7-bdec-40dc-b499-5e9cad8b0278-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:39 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cd3f5905-f18a-4bd7-9683-359cd77c6579 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Lock "cinder-4e401ef7-bdec-40dc-b499-5e9cad8b0278-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:39 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cd3f5905-f18a-4bd7-9683-359cd77c6579 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Acquiring lock "cinder-quobyte-4e401ef7-bdec-40dc-b499-5e9cad8b0278" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cd3f5905-f18a-4bd7-9683-359cd77c6579 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Lock "cinder-quobyte-4e401ef7-bdec-40dc-b499-5e9cad8b0278" acquired by "delete_volume" :: waited 0.026s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:40 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cc95b1-5a1e-4015-8fed-09d1d61ee7e8]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd3f5905-f18a-4bd7-9683-359cd77c6579 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:40 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278 Sep 04 15:58:40 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:40 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd3f5905-f18a-4bd7-9683-359cd77c6579 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278" returned: 0 in 0.502s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd3f5905-f18a-4bd7-9683-359cd77c6579 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:40 devstack sudo[99283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278 Sep 04 15:58:40 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:40 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd3f5905-f18a-4bd7-9683-359cd77c6579 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4e401ef7-bdec-40dc-b499-5e9cad8b0278" returned: 0 in 0.285s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cd3f5905-f18a-4bd7-9683-359cd77c6579 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Lock "cinder-quobyte-4e401ef7-bdec-40dc-b499-5e9cad8b0278" released by "delete_volume" :: held 0.871s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:40 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-cd3f5905-f18a-4bd7-9683-359cd77c6579 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Created reservations ['cec751e7-08a8-42d8-8272-082ed26dadea', '504f45c3-fe33-4fec-bd6f-90fa3fb02edf', '9a125bff-5683-4ab3-af10-d9e1049dd0a8', 'da7caa75-a79e-46fd-b009-c9ba9cad74cf'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:58:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-cd3f5905-f18a-4bd7-9683-359cd77c6579 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-cd3f5905-f18a-4bd7-9683-359cd77c6579 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:41 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-cd3f5905-f18a-4bd7-9683-359cd77c6579 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:41 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-cd3f5905-f18a-4bd7-9683-359cd77c6579 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-cd3f5905-f18a-4bd7-9683-359cd77c6579 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd3f5905-f18a-4bd7-9683-359cd77c6579 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:41 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:58:41 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:41 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd3f5905-f18a-4bd7-9683-359cd77c6579 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.344s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:41 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-cd3f5905-f18a-4bd7-9683-359cd77c6579 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:58:41 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-cd3f5905-f18a-4bd7-9683-359cd77c6579 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Deleted volume successfully. Sep 04 15:58:41 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cd3f5905-f18a-4bd7-9683-359cd77c6579 tempest-VolumeSnapshotQuotasNegativeTestJSON-30592300 None] Lock "cinder-4e401ef7-bdec-40dc-b499-5e9cad8b0278-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:43 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:58:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Flow 'volume_create_manager' (e019c15d-4b52-4b62-a5a3-ddcb6e34b6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f837b8ee-97eb-44cc-99d2-0d9a1e4d95a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f837b8ee-97eb-44cc-99d2-0d9a1e4d95a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-780625161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d887701-6626-450f-bd02-8adc8c0f2ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f49431a83fa4dfa9daf47e811008d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:43Z,use_quota=True,user_id='20ba54a3d8094921a89238615063c84b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e4bd7ad-851e-4cab-8008-db5b9b136cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e4bd7ad-851e-4cab-8008-db5b9b136cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b68d4a9a-2653-464b-b63b-864e9ee1bee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b68d4a9a-2653-464b-b63b-864e9ee1bee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d887701-6626-450f-bd02-8adc8c0f2ea3', 'volume_name': 'volume-2d887701-6626-450f-bd02-8adc8c0f2ea3', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92c392f8-2db7-4593-86fa-093ddc78ac51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92c392f8-2db7-4593-86fa-093ddc78ac51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46dbab23-a310-45e8-95d7-e27966dfd0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:43 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Volume 2d887701-6626-450f-bd02-8adc8c0f2ea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d887701-6626-450f-bd02-8adc8c0f2ea3', 'volume_size': 1} Sep 04 15:58:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-780625161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d887701-6626-450f-bd02-8adc8c0f2ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f49431a83fa4dfa9daf47e811008d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:43Z,use_quota=True,user_id='20ba54a3d8094921a89238615063c84b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:58:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Creating volume 2d887701-6626-450f-bd02-8adc8c0f2ea3 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:58:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:58:43 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:58:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:43 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3 1073741824 Sep 04 15:58:43 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:43 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3 1073741824" returned: 0 in 0.501s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:44 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3 Sep 04 15:58:44 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:44 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3" returned: 0 in 0.284s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:58:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46dbab23-a310-45e8-95d7-e27966dfd0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d887701-6626-450f-bd02-8adc8c0f2ea3', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (318951d8-9325-490a-9354-e11b421bd64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:44 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Volume volume-2d887701-6626-450f-bd02-8adc8c0f2ea3 (2d887701-6626-450f-bd02-8adc8c0f2ea3): created successfully Sep 04 15:58:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (318951d8-9325-490a-9354-e11b421bd64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Flow 'volume_create_manager' (e019c15d-4b52-4b62-a5a3-ddcb6e34b6d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:44 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-8e22dace-d904-4849-b290-0de5af61d05a tempest-SnapshotMetadataTestJSON-498779494 None] Created volume successfully. Sep 04 15:58:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5bf5723a-d9c8-42bf-ab98-528b155b3753 tempest-SnapshotMetadataTestJSON-498779494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5bf5723a-d9c8-42bf-ab98-528b155b3753 tempest-SnapshotMetadataTestJSON-498779494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-5bf5723a-d9c8-42bf-ab98-528b155b3753 tempest-SnapshotMetadataTestJSON-498779494 None] Creating offline snapshot 8f7062d8-452f-49f5-b83a-3d27d69b01e0 of volume 2d887701-6626-450f-bd02-8adc8c0f2ea3 {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:58:45 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a7a984-1900-4169-a0e3-a6208d448391]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5bf5723a-d9c8-42bf-ab98-528b155b3753 tempest-SnapshotMetadataTestJSON-498779494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:46 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3 Sep 04 15:58:46 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:46 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5bf5723a-d9c8-42bf-ab98-528b155b3753 tempest-SnapshotMetadataTestJSON-498779494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3" returned: 0 in 0.632s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5bf5723a-d9c8-42bf-ab98-528b155b3753 tempest-SnapshotMetadataTestJSON-498779494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3.8f7062d8-452f-49f5-b83a-3d27d69b01e0 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:46 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3.8f7062d8-452f-49f5-b83a-3d27d69b01e0 1G Sep 04 15:58:46 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:47 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5bf5723a-d9c8-42bf-ab98-528b155b3753 tempest-SnapshotMetadataTestJSON-498779494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3.8f7062d8-452f-49f5-b83a-3d27d69b01e0 1G" returned: 0 in 0.544s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5bf5723a-d9c8-42bf-ab98-528b155b3753 tempest-SnapshotMetadataTestJSON-498779494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d887701-6626-450f-bd02-8adc8c0f2ea3 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3.8f7062d8-452f-49f5-b83a-3d27d69b01e0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:47 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d887701-6626-450f-bd02-8adc8c0f2ea3 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3.8f7062d8-452f-49f5-b83a-3d27d69b01e0 Sep 04 15:58:47 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:47 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5bf5723a-d9c8-42bf-ab98-528b155b3753 tempest-SnapshotMetadataTestJSON-498779494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d887701-6626-450f-bd02-8adc8c0f2ea3 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3.8f7062d8-452f-49f5-b83a-3d27d69b01e0" returned: 0 in 0.440s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:47 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-5bf5723a-d9c8-42bf-ab98-528b155b3753 tempest-SnapshotMetadataTestJSON-498779494 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3.8f7062d8-452f-49f5-b83a-3d27d69b01e0 is being set with open permissions: ugo+rw Sep 04 15:58:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5bf5723a-d9c8-42bf-ab98-528b155b3753 tempest-SnapshotMetadataTestJSON-498779494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3.8f7062d8-452f-49f5-b83a-3d27d69b01e0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:47 devstack sudo[99409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3.8f7062d8-452f-49f5-b83a-3d27d69b01e0 Sep 04 15:58:47 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:47 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5bf5723a-d9c8-42bf-ab98-528b155b3753 tempest-SnapshotMetadataTestJSON-498779494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3.8f7062d8-452f-49f5-b83a-3d27d69b01e0" returned: 0 in 0.318s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5bf5723a-d9c8-42bf-ab98-528b155b3753 tempest-SnapshotMetadataTestJSON-498779494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:47 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3.info Sep 04 15:58:47 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:48 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5bf5723a-d9c8-42bf-ab98-528b155b3753 tempest-SnapshotMetadataTestJSON-498779494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3.info" returned: 0 in 0.271s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:48 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-5bf5723a-d9c8-42bf-ab98-528b155b3753 tempest-SnapshotMetadataTestJSON-498779494 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3.info is being set with open permissions: ugo+rw Sep 04 15:58:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5bf5723a-d9c8-42bf-ab98-528b155b3753 tempest-SnapshotMetadataTestJSON-498779494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:48 devstack sudo[99415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3.info Sep 04 15:58:48 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:48 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5bf5723a-d9c8-42bf-ab98-528b155b3753 tempest-SnapshotMetadataTestJSON-498779494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3.info" returned: 0 in 0.280s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5bf5723a-d9c8-42bf-ab98-528b155b3753 tempest-SnapshotMetadataTestJSON-498779494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.634s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:48 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-5bf5723a-d9c8-42bf-ab98-528b155b3753 tempest-SnapshotMetadataTestJSON-498779494 None] Create snapshot completed successfully Sep 04 15:58:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1287f8c7-857d-417e-b972-b15c6fc86be4 tempest-SnapshotMetadataTestJSON-498779494 None] Acquiring lock "cinder-8f7062d8-452f-49f5-b83a-3d27d69b01e0-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1287f8c7-857d-417e-b972-b15c6fc86be4 tempest-SnapshotMetadataTestJSON-498779494 None] Lock "cinder-8f7062d8-452f-49f5-b83a-3d27d69b01e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:50 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1287f8c7-857d-417e-b972-b15c6fc86be4 tempest-SnapshotMetadataTestJSON-498779494 None] Acquiring lock "cinder-quobyte-2d887701-6626-450f-bd02-8adc8c0f2ea3" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:50 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1287f8c7-857d-417e-b972-b15c6fc86be4 tempest-SnapshotMetadataTestJSON-498779494 None] Lock "cinder-quobyte-2d887701-6626-450f-bd02-8adc8c0f2ea3" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:50 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1287f8c7-857d-417e-b972-b15c6fc86be4 tempest-SnapshotMetadataTestJSON-498779494 None] Acquiring lock "cinder-quobyte-8f7062d8-452f-49f5-b83a-3d27d69b01e0" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:50 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1287f8c7-857d-417e-b972-b15c6fc86be4 tempest-SnapshotMetadataTestJSON-498779494 None] Lock "cinder-quobyte-8f7062d8-452f-49f5-b83a-3d27d69b01e0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-1287f8c7-857d-417e-b972-b15c6fc86be4 tempest-SnapshotMetadataTestJSON-498779494 None] Deleting offline snapshot 8f7062d8-452f-49f5-b83a-3d27d69b01e0 of volume 2d887701-6626-450f-bd02-8adc8c0f2ea3 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:58:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-1287f8c7-857d-417e-b972-b15c6fc86be4 tempest-SnapshotMetadataTestJSON-498779494 None] snapshot_file for this snap is: volume-2d887701-6626-450f-bd02-8adc8c0f2ea3.8f7062d8-452f-49f5-b83a-3d27d69b01e0 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:58:50 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[598424c7-d721-4b91-b624-bff969bfb942]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1287f8c7-857d-417e-b972-b15c6fc86be4 tempest-SnapshotMetadataTestJSON-498779494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3.8f7062d8-452f-49f5-b83a-3d27d69b01e0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:50 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3.8f7062d8-452f-49f5-b83a-3d27d69b01e0 Sep 04 15:58:50 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:50 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1287f8c7-857d-417e-b972-b15c6fc86be4 tempest-SnapshotMetadataTestJSON-498779494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3.8f7062d8-452f-49f5-b83a-3d27d69b01e0" returned: 0 in 0.386s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-1287f8c7-857d-417e-b972-b15c6fc86be4 tempest-SnapshotMetadataTestJSON-498779494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d887701-6626-450f-bd02-8adc8c0f2ea3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:58:50 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6d5ec1-880e-4cc9-b11c-139428cfa238]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1287f8c7-857d-417e-b972-b15c6fc86be4 tempest-SnapshotMetadataTestJSON-498779494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:50 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3 Sep 04 15:58:50 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:50 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1287f8c7-857d-417e-b972-b15c6fc86be4 tempest-SnapshotMetadataTestJSON-498779494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3" returned: 0 in 0.473s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1287f8c7-857d-417e-b972-b15c6fc86be4 tempest-SnapshotMetadataTestJSON-498779494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3.8f7062d8-452f-49f5-b83a-3d27d69b01e0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:51 devstack sudo[99452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3.8f7062d8-452f-49f5-b83a-3d27d69b01e0 Sep 04 15:58:51 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:51 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1287f8c7-857d-417e-b972-b15c6fc86be4 tempest-SnapshotMetadataTestJSON-498779494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3.8f7062d8-452f-49f5-b83a-3d27d69b01e0" returned: 0 in 0.406s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1287f8c7-857d-417e-b972-b15c6fc86be4 tempest-SnapshotMetadataTestJSON-498779494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3.8f7062d8-452f-49f5-b83a-3d27d69b01e0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:51 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3.8f7062d8-452f-49f5-b83a-3d27d69b01e0 Sep 04 15:58:51 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:51 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1287f8c7-857d-417e-b972-b15c6fc86be4 tempest-SnapshotMetadataTestJSON-498779494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3.8f7062d8-452f-49f5-b83a-3d27d69b01e0" returned: 0 in 0.358s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:51 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1287f8c7-857d-417e-b972-b15c6fc86be4 tempest-SnapshotMetadataTestJSON-498779494 None] Lock "cinder-quobyte-8f7062d8-452f-49f5-b83a-3d27d69b01e0" released by "_delete_snapshot" :: held 1.743s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:51 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1287f8c7-857d-417e-b972-b15c6fc86be4 tempest-SnapshotMetadataTestJSON-498779494 None] Lock "cinder-quobyte-2d887701-6626-450f-bd02-8adc8c0f2ea3" released by "delete_snapshot" :: held 1.768s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:51 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-1287f8c7-857d-417e-b972-b15c6fc86be4 tempest-SnapshotMetadataTestJSON-498779494 None] Created reservations ['a4485692-b3cb-4de7-91df-8c5605729d31', 'dc22ae3d-6c10-403a-96b5-1d57599834a1', 'a2ab8f00-def5-490e-9e13-168e3e547c99', '193eb051-fcf1-4572-bd3e-b66586aad666'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:58:51 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-1287f8c7-857d-417e-b972-b15c6fc86be4 tempest-SnapshotMetadataTestJSON-498779494 None] Delete snapshot completed successfully. Sep 04 15:58:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1287f8c7-857d-417e-b972-b15c6fc86be4 tempest-SnapshotMetadataTestJSON-498779494 None] Lock "cinder-8f7062d8-452f-49f5-b83a-3d27d69b01e0-delete_snapshot" released by "delete_snapshot" :: held 2.002s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7357b9de-e8e2-47fd-8c97-ace07ec5a6ca tempest-SnapshotMetadataTestJSON-498779494 None] Acquiring lock "cinder-2d887701-6626-450f-bd02-8adc8c0f2ea3-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7357b9de-e8e2-47fd-8c97-ace07ec5a6ca tempest-SnapshotMetadataTestJSON-498779494 None] Lock "cinder-2d887701-6626-450f-bd02-8adc8c0f2ea3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7357b9de-e8e2-47fd-8c97-ace07ec5a6ca tempest-SnapshotMetadataTestJSON-498779494 None] Acquiring lock "cinder-quobyte-2d887701-6626-450f-bd02-8adc8c0f2ea3" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:58:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7357b9de-e8e2-47fd-8c97-ace07ec5a6ca tempest-SnapshotMetadataTestJSON-498779494 None] Lock "cinder-quobyte-2d887701-6626-450f-bd02-8adc8c0f2ea3" acquired by "delete_volume" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:58:52 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[52dfe76d-a9ac-43e6-a4fa-0b30df6055a2]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7357b9de-e8e2-47fd-8c97-ace07ec5a6ca tempest-SnapshotMetadataTestJSON-498779494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:52 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3 Sep 04 15:58:52 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:52 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7357b9de-e8e2-47fd-8c97-ace07ec5a6ca tempest-SnapshotMetadataTestJSON-498779494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3" returned: 0 in 0.354s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7357b9de-e8e2-47fd-8c97-ace07ec5a6ca tempest-SnapshotMetadataTestJSON-498779494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:52 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3 Sep 04 15:58:52 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:52 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7357b9de-e8e2-47fd-8c97-ace07ec5a6ca tempest-SnapshotMetadataTestJSON-498779494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d887701-6626-450f-bd02-8adc8c0f2ea3" returned: 0 in 0.299s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7357b9de-e8e2-47fd-8c97-ace07ec5a6ca tempest-SnapshotMetadataTestJSON-498779494 None] Lock "cinder-quobyte-2d887701-6626-450f-bd02-8adc8c0f2ea3" released by "delete_volume" :: held 0.724s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:53 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-7357b9de-e8e2-47fd-8c97-ace07ec5a6ca tempest-SnapshotMetadataTestJSON-498779494 None] Created reservations ['85622407-cece-45f3-96bb-bd0ac1da8824', '8e8cd0b4-e500-4c12-964e-3281840f12ba', '49559788-ebf4-499d-9515-7c25eaeaccdf', 'c2c7a79a-e14c-4164-9c2c-bf7a1a8d09af'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:58:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7357b9de-e8e2-47fd-8c97-ace07ec5a6ca tempest-SnapshotMetadataTestJSON-498779494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7357b9de-e8e2-47fd-8c97-ace07ec5a6ca tempest-SnapshotMetadataTestJSON-498779494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7357b9de-e8e2-47fd-8c97-ace07ec5a6ca tempest-SnapshotMetadataTestJSON-498779494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7357b9de-e8e2-47fd-8c97-ace07ec5a6ca tempest-SnapshotMetadataTestJSON-498779494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7357b9de-e8e2-47fd-8c97-ace07ec5a6ca tempest-SnapshotMetadataTestJSON-498779494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7357b9de-e8e2-47fd-8c97-ace07ec5a6ca tempest-SnapshotMetadataTestJSON-498779494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:53 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:58:53 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:53 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7357b9de-e8e2-47fd-8c97-ace07ec5a6ca tempest-SnapshotMetadataTestJSON-498779494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.252s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:53 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-7357b9de-e8e2-47fd-8c97-ace07ec5a6ca tempest-SnapshotMetadataTestJSON-498779494 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:58:53 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-7357b9de-e8e2-47fd-8c97-ace07ec5a6ca tempest-SnapshotMetadataTestJSON-498779494 None] Deleted volume successfully. Sep 04 15:58:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7357b9de-e8e2-47fd-8c97-ace07ec5a6ca tempest-SnapshotMetadataTestJSON-498779494 None] Lock "cinder-2d887701-6626-450f-bd02-8adc8c0f2ea3-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Flow 'volume_create_manager' (d354253c-9378-478a-8bde-fb8174941b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36370b39-4940-43e9-9cd2-b7710ee465ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36370b39-4940-43e9-9cd2-b7710ee465ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-647124584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e991a0c-04fa-40d4-b480-b7e3ba6b4199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd51b0d07554481804347d221410fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:57Z,use_quota=True,user_id='38ed0ec14ae243268435d798ff85f83c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5920ee9e-e463-44ac-8917-e3acb9ad38fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5920ee9e-e463-44ac-8917-e3acb9ad38fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83114fba-346b-41d5-9227-ea032f66f294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83114fba-346b-41d5-9227-ea032f66f294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e991a0c-04fa-40d4-b480-b7e3ba6b4199', 'volume_name': 'volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4a7f2d-8974-4fd4-914b-18ef4c992902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4a7f2d-8974-4fd4-914b-18ef4c992902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94a1a693-7b43-4fb7-9f61-7928c040638b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:57 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Volume 2e991a0c-04fa-40d4-b480-b7e3ba6b4199: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199', 'volume_size': 1} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-647124584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e991a0c-04fa-40d4-b480-b7e3ba6b4199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd51b0d07554481804347d221410fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:57Z,use_quota=True,user_id='38ed0ec14ae243268435d798ff85f83c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Creating volume 2e991a0c-04fa-40d4-b480-b7e3ba6b4199 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:58:57 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:57 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199 1073741824 Sep 04 15:58:57 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Flow 'volume_create_manager' (c0a75057-1823-4ab5-bea5-3c77490eb162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67cb95ce-5cb5-4785-839e-3f029b687d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67cb95ce-5cb5-4785-839e-3f029b687d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1970304711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f08a547f-f69a-48cb-863e-44e6c17892a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be6b28495823465a966b5442bd80b171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:57Z,use_quota=True,user_id='3b0d2b026f264ffc864d2c45d1f123a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411c1192-55f1-4ac8-b01e-acd69a84e55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411c1192-55f1-4ac8-b01e-acd69a84e55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36de66fb-d93a-47ca-b72e-2423f9271d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36de66fb-d93a-47ca-b72e-2423f9271d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f08a547f-f69a-48cb-863e-44e6c17892a0', 'volume_name': 'volume-f08a547f-f69a-48cb-863e-44e6c17892a0', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ad454a-4adb-46e9-9163-5244a83216a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ad454a-4adb-46e9-9163-5244a83216a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1aca2a-c2d5-4067-87b0-654c546c9101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:57 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Volume f08a547f-f69a-48cb-863e-44e6c17892a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f08a547f-f69a-48cb-863e-44e6c17892a0', 'volume_size': 1} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:57 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199 1073741824" returned: 0 in 0.505s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:57 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199 Sep 04 15:58:57 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:58 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199" returned: 0 in 0.267s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:58:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.607s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1970304711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f08a547f-f69a-48cb-863e-44e6c17892a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be6b28495823465a966b5442bd80b171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:58:57Z,use_quota=True,user_id='3b0d2b026f264ffc864d2c45d1f123a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:58:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Creating volume f08a547f-f69a-48cb-863e-44e6c17892a0 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:58:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:58:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:58:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:58:58 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:58:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94a1a693-7b43-4fb7-9f61-7928c040638b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:58 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0 1073741824 Sep 04 15:58:58 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4336066a-1fb1-411a-8ec9-93ca014cf6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:58 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Volume volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199 (2e991a0c-04fa-40d4-b480-b7e3ba6b4199): created successfully Sep 04 15:58:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4336066a-1fb1-411a-8ec9-93ca014cf6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Flow 'volume_create_manager' (d354253c-9378-478a-8bde-fb8174941b4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:58 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-c89b8538-7097-45ae-9a39-5adff8b5d2fd tempest-VolumesDeleteCascade-1571857455 None] Created volume successfully. Sep 04 15:58:58 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0 1073741824" returned: 0 in 0.488s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:58 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0 Sep 04 15:58:58 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:58 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0" returned: 0 in 0.252s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:58:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:58:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1aca2a-c2d5-4067-87b0-654c546c9101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f08a547f-f69a-48cb-863e-44e6c17892a0', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3f7ea4-369d-4087-9dd3-59757099feda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:58:58 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Volume volume-f08a547f-f69a-48cb-863e-44e6c17892a0 (f08a547f-f69a-48cb-863e-44e6c17892a0): created successfully Sep 04 15:58:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3f7ea4-369d-4087-9dd3-59757099feda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:58:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Flow 'volume_create_manager' (c0a75057-1823-4ab5-bea5-3c77490eb162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:58:58 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-d3bbdcb7-8217-4130-808e-8c37dbb84bf9 tempest-VolumesCloneTest-2097505020 None] Created volume successfully. Sep 04 15:58:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2ab0e959-11cc-49fe-b277-ba210b088453 tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:58:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2ab0e959-11cc-49fe-b277-ba210b088453 tempest-VolumesDeleteCascade-1571857455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:58:59 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-2ab0e959-11cc-49fe-b277-ba210b088453 tempest-VolumesDeleteCascade-1571857455 None] Creating offline snapshot f807a238-72ec-46bd-a3bc-0866e9a48991 of volume 2e991a0c-04fa-40d4-b480-b7e3ba6b4199 {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:58:59 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7b40dc-d512-4495-a2ad-b586915b9603]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:58:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2ab0e959-11cc-49fe-b277-ba210b088453 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:59 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199 Sep 04 15:58:59 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:58:59 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Sep 04 15:58:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2ab0e959-11cc-49fe-b277-ba210b088453 tempest-VolumesDeleteCascade-1571857455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199" returned: 0 in 0.490s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:58:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2ab0e959-11cc-49fe-b277-ba210b088453 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:58:59 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991 1G Sep 04 15:58:59 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:00 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Flow 'volume_create_manager' (1e36a325-7e16-4f2d-afba-6b43e5d61df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb7fab8a-b482-4718-82cc-863da63c928c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb7fab8a-b482-4718-82cc-863da63c928c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2044739091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be6b28495823465a966b5442bd80b171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=f08a547f-f69a-48cb-863e-44e6c17892a0,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:00Z,use_quota=True,user_id='3b0d2b026f264ffc864d2c45d1f123a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ffb00b4-ca4e-435f-9c9e-84eaceed4acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ffb00b4-ca4e-435f-9c9e-84eaceed4acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d73e166d-dc0c-4df3-bf06-38df550eed3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d73e166d-dc0c-4df3-bf06-38df550eed3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca', 'volume_name': 'volume-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca', 'volume_size': 2, 'source_volid': 'f08a547f-f69a-48cb-863e-44e6c17892a0', 'source_volstatus': 'available'}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b126985b-ade6-42ab-8494-be0eb8d859e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b126985b-ade6-42ab-8494-be0eb8d859e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13062617-2f03-4839-b800-d15742946391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:00 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Volume 8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca', 'volume_size': 2, 'source_volid': 'f08a547f-f69a-48cb-863e-44e6c17892a0', 'source_volstatus': 'available'} Sep 04 15:59:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:00 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2ab0e959-11cc-49fe-b277-ba210b088453 tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991 1G" returned: 0 in 0.517s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2ab0e959-11cc-49fe-b277-ba210b088453 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d952ec2b-5b2c-43bc-9865-8113a8f8c0eb tempest-VolumesNegativeTest-23707419 None] Acquiring lock "cinder-6eb1d197-3157-4a43-85a6-8c316aca9e5f-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:00 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991 Sep 04 15:59:00 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d952ec2b-5b2c-43bc-9865-8113a8f8c0eb tempest-VolumesNegativeTest-23707419 None] Lock "cinder-6eb1d197-3157-4a43-85a6-8c316aca9e5f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d952ec2b-5b2c-43bc-9865-8113a8f8c0eb tempest-VolumesNegativeTest-23707419 None] Acquiring lock "cinder-quobyte-6eb1d197-3157-4a43-85a6-8c316aca9e5f" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d952ec2b-5b2c-43bc-9865-8113a8f8c0eb tempest-VolumesNegativeTest-23707419 None] Lock "cinder-quobyte-6eb1d197-3157-4a43-85a6-8c316aca9e5f" acquired by "delete_volume" :: waited 0.016s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:00 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc66fcc-7f4d-4948-9709-775ec58696b7]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d952ec2b-5b2c-43bc-9865-8113a8f8c0eb tempest-VolumesNegativeTest-23707419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6eb1d197-3157-4a43-85a6-8c316aca9e5f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:00 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6eb1d197-3157-4a43-85a6-8c316aca9e5f Sep 04 15:59:00 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:00 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2ab0e959-11cc-49fe-b277-ba210b088453 tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991" returned: 0 in 0.338s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:00 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-2ab0e959-11cc-49fe-b277-ba210b088453 tempest-VolumesDeleteCascade-1571857455 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991 is being set with open permissions: ugo+rw Sep 04 15:59:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2ab0e959-11cc-49fe-b277-ba210b088453 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:00 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991 Sep 04 15:59:00 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:00 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d952ec2b-5b2c-43bc-9865-8113a8f8c0eb tempest-VolumesNegativeTest-23707419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6eb1d197-3157-4a43-85a6-8c316aca9e5f" returned: 0 in 0.413s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d952ec2b-5b2c-43bc-9865-8113a8f8c0eb tempest-VolumesNegativeTest-23707419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6eb1d197-3157-4a43-85a6-8c316aca9e5f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:01 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6eb1d197-3157-4a43-85a6-8c316aca9e5f Sep 04 15:59:01 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:01 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2ab0e959-11cc-49fe-b277-ba210b088453 tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991" returned: 0 in 0.284s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2ab0e959-11cc-49fe-b277-ba210b088453 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:01 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.info Sep 04 15:59:01 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:01 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d952ec2b-5b2c-43bc-9865-8113a8f8c0eb tempest-VolumesNegativeTest-23707419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6eb1d197-3157-4a43-85a6-8c316aca9e5f" returned: 0 in 0.252s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d952ec2b-5b2c-43bc-9865-8113a8f8c0eb tempest-VolumesNegativeTest-23707419 None] Lock "cinder-quobyte-6eb1d197-3157-4a43-85a6-8c316aca9e5f" released by "delete_volume" :: held 0.706s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:01 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-d952ec2b-5b2c-43bc-9865-8113a8f8c0eb tempest-VolumesNegativeTest-23707419 None] Created reservations ['9de81097-0631-4161-8d37-43cad7d9e315', '7c41a2c9-dfb1-48e5-b032-88d25239ab90', '2762e602-9d8a-44a8-88f6-671db1825c57', 'e69d5479-1404-40a9-bd2f-854d5eac870f'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:01 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2ab0e959-11cc-49fe-b277-ba210b088453 tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.info" returned: 0 in 0.258s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:01 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-2ab0e959-11cc-49fe-b277-ba210b088453 tempest-VolumesDeleteCascade-1571857455 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.info is being set with open permissions: ugo+rw Sep 04 15:59:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2ab0e959-11cc-49fe-b277-ba210b088453 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d952ec2b-5b2c-43bc-9865-8113a8f8c0eb tempest-VolumesNegativeTest-23707419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d952ec2b-5b2c-43bc-9865-8113a8f8c0eb tempest-VolumesNegativeTest-23707419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:01 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d952ec2b-5b2c-43bc-9865-8113a8f8c0eb tempest-VolumesNegativeTest-23707419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:59:01 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d952ec2b-5b2c-43bc-9865-8113a8f8c0eb tempest-VolumesNegativeTest-23707419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:59:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d952ec2b-5b2c-43bc-9865-8113a8f8c0eb tempest-VolumesNegativeTest-23707419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d952ec2b-5b2c-43bc-9865-8113a8f8c0eb tempest-VolumesNegativeTest-23707419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:01 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.info Sep 04 15:59:01 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:01 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:59:01 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:01 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2ab0e959-11cc-49fe-b277-ba210b088453 tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.info" returned: 0 in 0.257s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:01 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2ab0e959-11cc-49fe-b277-ba210b088453 tempest-VolumesDeleteCascade-1571857455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.253s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.415s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:01 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Cloning volume f08a547f-f69a-48cb-863e-44e6c17892a0 to volume 8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca Sep 04 15:59:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d952ec2b-5b2c-43bc-9865-8113a8f8c0eb tempest-VolumesNegativeTest-23707419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.277s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:01 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d952ec2b-5b2c-43bc-9865-8113a8f8c0eb tempest-VolumesNegativeTest-23707419 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:01 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-d952ec2b-5b2c-43bc-9865-8113a8f8c0eb tempest-VolumesNegativeTest-23707419 None] Deleted volume successfully. Sep 04 15:59:01 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Creating offline snapshot 0dbfe4d3-0ec7-4e9d-84db-c720d0134d97 of volume f08a547f-f69a-48cb-863e-44e6c17892a0 {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:59:01 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-2ab0e959-11cc-49fe-b277-ba210b088453 tempest-VolumesDeleteCascade-1571857455 None] Create snapshot completed successfully Sep 04 15:59:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d952ec2b-5b2c-43bc-9865-8113a8f8c0eb tempest-VolumesNegativeTest-23707419 None] Lock "cinder-6eb1d197-3157-4a43-85a6-8c316aca9e5f-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:01 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b99826-2226-4135-a2b3-99614a415c32]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:01 devstack sudo[99530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0 Sep 04 15:59:01 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:02 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0" returned: 0 in 0.388s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.0dbfe4d3-0ec7-4e9d-84db-c720d0134d97 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:02 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.0dbfe4d3-0ec7-4e9d-84db-c720d0134d97 1G Sep 04 15:59:02 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:02 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.0dbfe4d3-0ec7-4e9d-84db-c720d0134d97 1G" returned: 0 in 0.446s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f08a547f-f69a-48cb-863e-44e6c17892a0 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.0dbfe4d3-0ec7-4e9d-84db-c720d0134d97 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:02 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f08a547f-f69a-48cb-863e-44e6c17892a0 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.0dbfe4d3-0ec7-4e9d-84db-c720d0134d97 Sep 04 15:59:02 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-42d13da8-059c-486a-a254-0928b8f9f060 tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:02 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f08a547f-f69a-48cb-863e-44e6c17892a0 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.0dbfe4d3-0ec7-4e9d-84db-c720d0134d97" returned: 0 in 0.330s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:02 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.0dbfe4d3-0ec7-4e9d-84db-c720d0134d97 is being set with open permissions: ugo+rw Sep 04 15:59:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.0dbfe4d3-0ec7-4e9d-84db-c720d0134d97 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:02 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.0dbfe4d3-0ec7-4e9d-84db-c720d0134d97 Sep 04 15:59:02 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:03 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.0dbfe4d3-0ec7-4e9d-84db-c720d0134d97" returned: 0 in 0.260s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:03 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.info Sep 04 15:59:03 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:03 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.info" returned: 0 in 0.252s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:03 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.info is being set with open permissions: ugo+rw Sep 04 15:59:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:03 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.info Sep 04 15:59:03 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:03 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.info" returned: 0 in 0.242s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Acquiring lock "cinder-quobyte-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca" by "_copy_volume_from_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Lock "cinder-quobyte-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] snapshot: 0dbfe4d3-0ec7-4e9d-84db-c720d0134d97, volume: 8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca, {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 15:59:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:59:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:59:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:03 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ed27b6-2e17-47c9-95f4-fdcce7cbfa53]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.0dbfe4d3-0ec7-4e9d-84db-c720d0134d97 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:03 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.0dbfe4d3-0ec7-4e9d-84db-c720d0134d97 Sep 04 15:59:03 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:04 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.0dbfe4d3-0ec7-4e9d-84db-c720d0134d97" returned: 0 in 0.406s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:04 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f08a547f-f69a-48cb-863e-44e6c17892a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:59:04 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[801d2965-6741-453b-825d-cdde4429adb2]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:04 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0 Sep 04 15:59:04 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:04 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Flow 'volume_create_manager' (94a41c18-b970-4719-8b79-73bc530e0482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d66eb8e-2355-4ec2-814e-e794dcfaf035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d66eb8e-2355-4ec2-814e-e794dcfaf035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1153992361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0091f9b-b4f6-4a53-94ae-0e4b4863b41c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1e22f51dda45c9b1b4efa12afcfd0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:04Z,use_quota=True,user_id='4e4b00c391934158b052aeb8a0150aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5910698d-0cd2-4760-b33e-f5f4ce937aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5910698d-0cd2-4760-b33e-f5f4ce937aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c43b64-07f0-4555-8e1e-0543f962522d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c43b64-07f0-4555-8e1e-0543f962522d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0091f9b-b4f6-4a53-94ae-0e4b4863b41c', 'volume_name': 'volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2a1284-5ef3-4fde-a085-0e9d39953d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2a1284-5ef3-4fde-a085-0e9d39953d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1fb487a-127d-48b5-81fd-2e9f8e0a1a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:04 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Volume b0091f9b-b4f6-4a53-94ae-0e4b4863b41c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c', 'volume_size': 1} Sep 04 15:59:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:04 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0" returned: 0 in 0.367s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:04 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0 {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 15:59:04 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Creating direct copy from snapshot {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 15:59:04 devstack cinder-volume[87490]: DEBUG cinder.utils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Path /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca not found in is_blk_device check {{(pid=87490) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 15:59:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:04 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca Sep 04 15:59:04 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:08 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca" returned: 0 in 4.025s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:08 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0, size 1024.00 MB, duration 4.03 sec, destination /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca {{(pid=87490) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 15:59:08 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Converted 1024.00 MB image at 254.28 MB/s Sep 04 15:59:08 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca is being set with open permissions: ugo+rw Sep 04 15:59:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:08 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca Sep 04 15:59:08 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:08 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca" returned: 0 in 0.239s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:08 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Lock "cinder-quobyte-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca" released by "_copy_volume_from_snapshot" :: held 5.124s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:08 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Acquiring lock "cinder-quobyte-0dbfe4d3-0ec7-4e9d-84db-c720d0134d97" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:08 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Lock "cinder-quobyte-0dbfe4d3-0ec7-4e9d-84db-c720d0134d97" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:08 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Deleting offline snapshot 0dbfe4d3-0ec7-4e9d-84db-c720d0134d97 of volume f08a547f-f69a-48cb-863e-44e6c17892a0 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:59:08 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] snapshot_file for this snap is: volume-f08a547f-f69a-48cb-863e-44e6c17892a0.0dbfe4d3-0ec7-4e9d-84db-c720d0134d97 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:59:08 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f44e42a-14b2-431c-9c96-cdf6a09be0ba]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.0dbfe4d3-0ec7-4e9d-84db-c720d0134d97 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:08 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.0dbfe4d3-0ec7-4e9d-84db-c720d0134d97 Sep 04 15:59:08 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:09 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.0dbfe4d3-0ec7-4e9d-84db-c720d0134d97" returned: 0 in 0.392s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:09 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f08a547f-f69a-48cb-863e-44e6c17892a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:59:09 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fc9bb7-e31d-4bdc-87bd-7d4537cc9c77]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:09 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0 Sep 04 15:59:09 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:09 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0" returned: 0 in 0.516s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.0dbfe4d3-0ec7-4e9d-84db-c720d0134d97 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:09 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.0dbfe4d3-0ec7-4e9d-84db-c720d0134d97 Sep 04 15:59:09 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:10 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.0dbfe4d3-0ec7-4e9d-84db-c720d0134d97" returned: 0 in 0.320s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.0dbfe4d3-0ec7-4e9d-84db-c720d0134d97 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:10 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.0dbfe4d3-0ec7-4e9d-84db-c720d0134d97 Sep 04 15:59:10 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:10 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0.0dbfe4d3-0ec7-4e9d-84db-c720d0134d97" returned: 0 in 0.252s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:10 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Lock "cinder-quobyte-0dbfe4d3-0ec7-4e9d-84db-c720d0134d97" released by "_delete_snapshot" :: held 1.567s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.816s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-42d13da8-059c-486a-a254-0928b8f9f060 tempest-VolumesDeleteCascade-1571857455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.733s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-42d13da8-059c-486a-a254-0928b8f9f060 tempest-VolumesDeleteCascade-1571857455 None] Creating offline snapshot d665e8a1-bc64-46fa-b6fb-2ab93c0065f3 of volume 2e991a0c-04fa-40d4-b480-b7e3ba6b4199 {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:59:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13062617-2f03-4839-b800-d15742946391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca', 'volume_size': 2, 'source_volid': 'f08a547f-f69a-48cb-863e-44e6c17892a0', 'source_volstatus': 'available'}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc87d72e-9709-49c1-90cd-f647518a72ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:10 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b47c99d-348d-46a8-8d45-e9e8b569ebf5]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-42d13da8-059c-486a-a254-0928b8f9f060 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:10 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Volume volume-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca (8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca): created successfully Sep 04 15:59:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc87d72e-9709-49c1-90cd-f647518a72ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Flow 'volume_create_manager' (1e36a325-7e16-4f2d-afba-6b43e5d61df6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:10 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-5a3b57c9-3478-4759-b770-7bb8c09ec64d tempest-VolumesCloneTest-2097505020 None] Created volume successfully. Sep 04 15:59:10 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991 Sep 04 15:59:10 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:10 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-42d13da8-059c-486a-a254-0928b8f9f060 tempest-VolumesDeleteCascade-1571857455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991" returned: 0 in 0.382s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-42d13da8-059c-486a-a254-0928b8f9f060 tempest-VolumesDeleteCascade-1571857455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:59:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-42d13da8-059c-486a-a254-0928b8f9f060 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.d665e8a1-bc64-46fa-b6fb-2ab93c0065f3 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:10 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.d665e8a1-bc64-46fa-b6fb-2ab93c0065f3 1G Sep 04 15:59:10 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:10 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4d8f4712-67f1-45a0-9577-0c0d65efba04 tempest-VolumesCloneTest-2097505020 None] Acquiring lock "cinder-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4d8f4712-67f1-45a0-9577-0c0d65efba04 tempest-VolumesCloneTest-2097505020 None] Lock "cinder-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4d8f4712-67f1-45a0-9577-0c0d65efba04 tempest-VolumesCloneTest-2097505020 None] Acquiring lock "cinder-quobyte-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4d8f4712-67f1-45a0-9577-0c0d65efba04 tempest-VolumesCloneTest-2097505020 None] Lock "cinder-quobyte-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca" acquired by "delete_volume" :: waited 0.024s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[5484b20c-1358-479f-8d86-a0b8663a7a3e]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4d8f4712-67f1-45a0-9577-0c0d65efba04 tempest-VolumesCloneTest-2097505020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:11 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca Sep 04 15:59:11 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:11 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-42d13da8-059c-486a-a254-0928b8f9f060 tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.d665e8a1-bc64-46fa-b6fb-2ab93c0065f3 1G" returned: 0 in 0.438s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-42d13da8-059c-486a-a254-0928b8f9f060 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.d665e8a1-bc64-46fa-b6fb-2ab93c0065f3 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:11 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.d665e8a1-bc64-46fa-b6fb-2ab93c0065f3 Sep 04 15:59:11 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:11 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4d8f4712-67f1-45a0-9577-0c0d65efba04 tempest-VolumesCloneTest-2097505020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca" returned: 0 in 0.363s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4d8f4712-67f1-45a0-9577-0c0d65efba04 tempest-VolumesCloneTest-2097505020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:11 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca Sep 04 15:59:11 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:11 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-42d13da8-059c-486a-a254-0928b8f9f060 tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.d665e8a1-bc64-46fa-b6fb-2ab93c0065f3" returned: 0 in 0.305s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:11 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-42d13da8-059c-486a-a254-0928b8f9f060 tempest-VolumesDeleteCascade-1571857455 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.d665e8a1-bc64-46fa-b6fb-2ab93c0065f3 is being set with open permissions: ugo+rw Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-42d13da8-059c-486a-a254-0928b8f9f060 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.d665e8a1-bc64-46fa-b6fb-2ab93c0065f3 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:11 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.d665e8a1-bc64-46fa-b6fb-2ab93c0065f3 Sep 04 15:59:11 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:11 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4d8f4712-67f1-45a0-9577-0c0d65efba04 tempest-VolumesCloneTest-2097505020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca" returned: 0 in 0.257s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4d8f4712-67f1-45a0-9577-0c0d65efba04 tempest-VolumesCloneTest-2097505020 None] Lock "cinder-quobyte-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca" released by "delete_volume" :: held 0.674s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-4d8f4712-67f1-45a0-9577-0c0d65efba04 tempest-VolumesCloneTest-2097505020 None] Created reservations ['5a9cfa0f-60c8-4771-bcc2-306a587ea34a', '58e9efe2-de16-47c4-bc69-8e88abe1eabf', 'ed1ed62e-7897-464d-a1bd-920223c8e0a8', 'a6310e6d-b2a2-436f-80d8-dce85c2f080c'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4d8f4712-67f1-45a0-9577-0c0d65efba04 tempest-VolumesCloneTest-2097505020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4d8f4712-67f1-45a0-9577-0c0d65efba04 tempest-VolumesCloneTest-2097505020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:11 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4d8f4712-67f1-45a0-9577-0c0d65efba04 tempest-VolumesCloneTest-2097505020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4d8f4712-67f1-45a0-9577-0c0d65efba04 tempest-VolumesCloneTest-2097505020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4d8f4712-67f1-45a0-9577-0c0d65efba04 tempest-VolumesCloneTest-2097505020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4d8f4712-67f1-45a0-9577-0c0d65efba04 tempest-VolumesCloneTest-2097505020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-42d13da8-059c-486a-a254-0928b8f9f060 tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.d665e8a1-bc64-46fa-b6fb-2ab93c0065f3" returned: 0 in 0.283s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:11 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:59:11 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-42d13da8-059c-486a-a254-0928b8f9f060 tempest-VolumesDeleteCascade-1571857455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.507s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.599s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1153992361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0091f9b-b4f6-4a53-94ae-0e4b4863b41c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1e22f51dda45c9b1b4efa12afcfd0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:04Z,use_quota=True,user_id='4e4b00c391934158b052aeb8a0150aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Creating volume b0091f9b-b4f6-4a53-94ae-0e4b4863b41c {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:59:11 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:59:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:11 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c 1073741824 Sep 04 15:59:11 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:12 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-42d13da8-059c-486a-a254-0928b8f9f060 tempest-VolumesDeleteCascade-1571857455 None] Create snapshot completed successfully Sep 04 15:59:12 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4d8f4712-67f1-45a0-9577-0c0d65efba04 tempest-VolumesCloneTest-2097505020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.274s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-4d8f4712-67f1-45a0-9577-0c0d65efba04 tempest-VolumesCloneTest-2097505020 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:12 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-4d8f4712-67f1-45a0-9577-0c0d65efba04 tempest-VolumesCloneTest-2097505020 None] Deleted volume successfully. Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4d8f4712-67f1-45a0-9577-0c0d65efba04 tempest-VolumesCloneTest-2097505020 None] Lock "cinder-8b2deb86-b74e-46cc-a77d-63fc0ec6b2ca-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "cinder-2e991a0c-04fa-40d4-b480-b7e3ba6b4199-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ac75a719-b7d4-42da-95a1-f39447fd7b59 tempest-VolumesCloneTest-2097505020 None] Acquiring lock "cinder-f08a547f-f69a-48cb-863e-44e6c17892a0-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ac75a719-b7d4-42da-95a1-f39447fd7b59 tempest-VolumesCloneTest-2097505020 None] Lock "cinder-f08a547f-f69a-48cb-863e-44e6c17892a0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-2e991a0c-04fa-40d4-b480-b7e3ba6b4199-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ac75a719-b7d4-42da-95a1-f39447fd7b59 tempest-VolumesCloneTest-2097505020 None] Acquiring lock "cinder-quobyte-f08a547f-f69a-48cb-863e-44e6c17892a0" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Performing cascade delete. {{(pid=87490) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "cinder-d665e8a1-bc64-46fa-b6fb-2ab93c0065f3-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ac75a719-b7d4-42da-95a1-f39447fd7b59 tempest-VolumesCloneTest-2097505020 None] Lock "cinder-quobyte-f08a547f-f69a-48cb-863e-44e6c17892a0" acquired by "delete_volume" :: waited 0.027s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-d665e8a1-bc64-46fa-b6fb-2ab93c0065f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25907b9-02e9-4148-9fe0-9170b4f33dd6]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ac75a719-b7d4-42da-95a1-f39447fd7b59 tempest-VolumesCloneTest-2097505020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "cinder-quobyte-2e991a0c-04fa-40d4-b480-b7e3ba6b4199" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-quobyte-2e991a0c-04fa-40d4-b480-b7e3ba6b4199" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "cinder-quobyte-d665e8a1-bc64-46fa-b6fb-2ab93c0065f3" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-quobyte-d665e8a1-bc64-46fa-b6fb-2ab93c0065f3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Deleting offline snapshot d665e8a1-bc64-46fa-b6fb-2ab93c0065f3 of volume 2e991a0c-04fa-40d4-b480-b7e3ba6b4199 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] snapshot_file for this snap is: volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.d665e8a1-bc64-46fa-b6fb-2ab93c0065f3 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:59:12 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c 1073741824" returned: 0 in 0.535s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8a21fe-789f-4580-9cba-29f3f830c92b]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.d665e8a1-bc64-46fa-b6fb-2ab93c0065f3 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:12 devstack sudo[99636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0 Sep 04 15:59:12 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:12 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c Sep 04 15:59:12 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:12 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.d665e8a1-bc64-46fa-b6fb-2ab93c0065f3 Sep 04 15:59:12 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:12 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ac75a719-b7d4-42da-95a1-f39447fd7b59 tempest-VolumesCloneTest-2097505020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0" returned: 0 in 0.376s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ac75a719-b7d4-42da-95a1-f39447fd7b59 tempest-VolumesCloneTest-2097505020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:12 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0 Sep 04 15:59:12 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:12 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c" returned: 0 in 0.302s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1fb487a-127d-48b5-81fd-2e9f8e0a1a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ddbd58f-2e0b-482a-9e0a-4bd9ea19d08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:12 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Volume volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c (b0091f9b-b4f6-4a53-94ae-0e4b4863b41c): created successfully Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ddbd58f-2e0b-482a-9e0a-4bd9ea19d08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Flow 'volume_create_manager' (94a41c18-b970-4719-8b79-73bc530e0482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:12 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-263ddb13-39cc-4c6c-b11b-6fbcf9b455c5 tempest-VolumesSnapshotListTestJSON-2123040737 None] Created volume successfully. Sep 04 15:59:12 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.d665e8a1-bc64-46fa-b6fb-2ab93c0065f3" returned: 0 in 0.419s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e39fdb2-6a68-4e31-94fd-0fcbfc79de89]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:13 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991 Sep 04 15:59:13 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:13 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ac75a719-b7d4-42da-95a1-f39447fd7b59 tempest-VolumesCloneTest-2097505020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f08a547f-f69a-48cb-863e-44e6c17892a0" returned: 0 in 0.284s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:13 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ac75a719-b7d4-42da-95a1-f39447fd7b59 tempest-VolumesCloneTest-2097505020 None] Lock "cinder-quobyte-f08a547f-f69a-48cb-863e-44e6c17892a0" released by "delete_volume" :: held 0.719s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:13 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-ac75a719-b7d4-42da-95a1-f39447fd7b59 tempest-VolumesCloneTest-2097505020 None] Created reservations ['524115b7-84b6-42e8-932d-b2ab49a9e47b', 'e66a55d7-2003-488a-a928-c539bf64ff0c', '4d141e33-922d-4890-b53b-effeb5a80ba0', 'aae3603d-47dc-4b71-bd56-7862214b3c42'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ac75a719-b7d4-42da-95a1-f39447fd7b59 tempest-VolumesCloneTest-2097505020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ac75a719-b7d4-42da-95a1-f39447fd7b59 tempest-VolumesCloneTest-2097505020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ac75a719-b7d4-42da-95a1-f39447fd7b59 tempest-VolumesCloneTest-2097505020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:59:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ac75a719-b7d4-42da-95a1-f39447fd7b59 tempest-VolumesCloneTest-2097505020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:59:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ac75a719-b7d4-42da-95a1-f39447fd7b59 tempest-VolumesCloneTest-2097505020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ac75a719-b7d4-42da-95a1-f39447fd7b59 tempest-VolumesCloneTest-2097505020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:13 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:59:13 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:13 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991" returned: 0 in 0.370s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:59:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.d665e8a1-bc64-46fa-b6fb-2ab93c0065f3 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:13 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.d665e8a1-bc64-46fa-b6fb-2ab93c0065f3 Sep 04 15:59:13 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:13 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ac75a719-b7d4-42da-95a1-f39447fd7b59 tempest-VolumesCloneTest-2097505020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.294s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:13 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-ac75a719-b7d4-42da-95a1-f39447fd7b59 tempest-VolumesCloneTest-2097505020 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:13 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-ac75a719-b7d4-42da-95a1-f39447fd7b59 tempest-VolumesCloneTest-2097505020 None] Deleted volume successfully. Sep 04 15:59:13 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ac75a719-b7d4-42da-95a1-f39447fd7b59 tempest-VolumesCloneTest-2097505020 None] Lock "cinder-f08a547f-f69a-48cb-863e-44e6c17892a0-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:13 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.d665e8a1-bc64-46fa-b6fb-2ab93c0065f3" returned: 0 in 0.390s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.d665e8a1-bc64-46fa-b6fb-2ab93c0065f3 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:13 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.d665e8a1-bc64-46fa-b6fb-2ab93c0065f3 Sep 04 15:59:13 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:13 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.d665e8a1-bc64-46fa-b6fb-2ab93c0065f3" returned: 0 in 0.271s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-quobyte-d665e8a1-bc64-46fa-b6fb-2ab93c0065f3" released by "_delete_snapshot" :: held 1.553s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-quobyte-2e991a0c-04fa-40d4-b480-b7e3ba6b4199" released by "delete_snapshot" :: held 1.575s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:14 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Created reservations ['184943c8-414b-4504-86b4-937ba8290b7f', '05b1596c-5bc4-4d81-9b4b-7a6843ae632d', '4a37bc83-927d-4e2d-89b7-1068256bda18', '4f83da88-b977-4b9f-a42f-8f6fcfaa5947'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:14 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Delete snapshot completed successfully. Sep 04 15:59:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-d665e8a1-bc64-46fa-b6fb-2ab93c0065f3-delete_snapshot" released by "delete_snapshot" :: held 1.761s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "cinder-f807a238-72ec-46bd-a3bc-0866e9a48991-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-f807a238-72ec-46bd-a3bc-0866e9a48991-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "cinder-quobyte-2e991a0c-04fa-40d4-b480-b7e3ba6b4199" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-quobyte-2e991a0c-04fa-40d4-b480-b7e3ba6b4199" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "cinder-quobyte-f807a238-72ec-46bd-a3bc-0866e9a48991" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-quobyte-f807a238-72ec-46bd-a3bc-0866e9a48991" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Deleting offline snapshot f807a238-72ec-46bd-a3bc-0866e9a48991 of volume 2e991a0c-04fa-40d4-b480-b7e3ba6b4199 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:59:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] snapshot_file for this snap is: volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:59:14 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab43af20-72cd-4e23-ac2d-22762aa076aa]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-070b19ed-da0c-4548-aca7-a09aff629bad tempest-VolumesSnapshotListTestJSON-2123040737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-070b19ed-da0c-4548-aca7-a09aff629bad tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-070b19ed-da0c-4548-aca7-a09aff629bad tempest-VolumesSnapshotListTestJSON-2123040737 None] Creating offline snapshot d433bfbe-0ccb-4db7-ad67-e19ea27716c8 of volume b0091f9b-b4f6-4a53-94ae-0e4b4863b41c {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:59:14 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[56333c75-a723-408e-b1e2-98837ef3899c]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-070b19ed-da0c-4548-aca7-a09aff629bad tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:14 devstack sudo[99669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991 Sep 04 15:59:14 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:14 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c Sep 04 15:59:14 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:14 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991" returned: 0 in 0.400s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:59:14 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bb471a-c436-4964-a06a-bbc6ccb209ae]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:14 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-070b19ed-da0c-4548-aca7-a09aff629bad tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c" returned: 0 in 0.395s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-070b19ed-da0c-4548-aca7-a09aff629bad tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:14 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8 1G Sep 04 15:59:14 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:14 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199 Sep 04 15:59:14 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:15 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199" returned: 0 in 0.435s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:15 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991 Sep 04 15:59:15 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:15 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-070b19ed-da0c-4548-aca7-a09aff629bad tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8 1G" returned: 0 in 0.469s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-070b19ed-da0c-4548-aca7-a09aff629bad tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:15 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8 Sep 04 15:59:15 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:15 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991" returned: 0 in 0.360s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:15 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-070b19ed-da0c-4548-aca7-a09aff629bad tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8" returned: 0 in 0.322s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:15 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-070b19ed-da0c-4548-aca7-a09aff629bad tempest-VolumesSnapshotListTestJSON-2123040737 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8 is being set with open permissions: ugo+rw Sep 04 15:59:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-070b19ed-da0c-4548-aca7-a09aff629bad tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:15 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991 Sep 04 15:59:15 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:15 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8 Sep 04 15:59:15 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:15 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-070b19ed-da0c-4548-aca7-a09aff629bad tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8" returned: 0 in 0.284s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:15 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199.f807a238-72ec-46bd-a3bc-0866e9a48991" returned: 0 in 0.317s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:15 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-quobyte-f807a238-72ec-46bd-a3bc-0866e9a48991" released by "_delete_snapshot" :: held 1.634s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:15 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-quobyte-2e991a0c-04fa-40d4-b480-b7e3ba6b4199" released by "delete_snapshot" :: held 1.667s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-070b19ed-da0c-4548-aca7-a09aff629bad tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:15 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.info Sep 04 15:59:15 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Created reservations ['e0bc6eb8-1702-45a1-b9f5-a1613a94f3e6', 'ac281514-e59e-4c06-b679-04d6a49dd379', '353ff1fb-66c4-461c-85af-b7db68dd6970', 'c139e6f6-197b-4884-973b-62c90f6b312b'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:16 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Delete snapshot completed successfully. Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-f807a238-72ec-46bd-a3bc-0866e9a48991-delete_snapshot" released by "delete_snapshot" :: held 1.876s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Snapshots deleted, issuing volume delete {{(pid=87490) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "cinder-quobyte-2e991a0c-04fa-40d4-b480-b7e3ba6b4199" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-quobyte-2e991a0c-04fa-40d4-b480-b7e3ba6b4199" acquired by "delete_volume" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bd7352-6390-44fc-9a3a-98420ff7e1a1]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:16 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199 Sep 04 15:59:16 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:16 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-070b19ed-da0c-4548-aca7-a09aff629bad tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.info" returned: 0 in 0.346s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:16 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-070b19ed-da0c-4548-aca7-a09aff629bad tempest-VolumesSnapshotListTestJSON-2123040737 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.info is being set with open permissions: ugo+rw Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-070b19ed-da0c-4548-aca7-a09aff629bad tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:16 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.info Sep 04 15:59:16 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:16 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199" returned: 0 in 0.415s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:16 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-070b19ed-da0c-4548-aca7-a09aff629bad tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.info" returned: 0 in 0.304s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:16 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199 Sep 04 15:59:16 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-070b19ed-da0c-4548-aca7-a09aff629bad tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.273s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:16 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-070b19ed-da0c-4548-aca7-a09aff629bad tempest-VolumesSnapshotListTestJSON-2123040737 None] Create snapshot completed successfully Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Flow 'volume_create_manager' (9eb6c36b-a733-4aaa-8cd0-ccb642335c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99e0314-2edf-41e7-8ffb-2f5179f8aa68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99e0314-2edf-41e7-8ffb-2f5179f8aa68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-221575961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d5f394-5e2f-4fba-8c22-9938fc60c2e5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e958005d63114a308a1fe83ce485f5f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:17Z,use_quota=True,user_id='12336b3bfc7a4918bf5a62161901142d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (906d5a7e-d264-4004-8af7-d3d6507a2b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (906d5a7e-d264-4004-8af7-d3d6507a2b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bfe6f17-c409-40b3-adca-a825b4016cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bfe6f17-c409-40b3-adca-a825b4016cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01d5f394-5e2f-4fba-8c22-9938fc60c2e5', 'volume_name': 'volume-01d5f394-5e2f-4fba-8c22-9938fc60c2e5', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (402527ee-b45f-4bea-a8bc-0457d363a9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (402527ee-b45f-4bea-a8bc-0457d363a9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7a55e2-dcbc-4ec0-b4fd-b5310e8ffadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:16 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Volume 01d5f394-5e2f-4fba-8c22-9938fc60c2e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01d5f394-5e2f-4fba-8c22-9938fc60c2e5', 'volume_size': 1} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-221575961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d5f394-5e2f-4fba-8c22-9938fc60c2e5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e958005d63114a308a1fe83ce485f5f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:17Z,use_quota=True,user_id='12336b3bfc7a4918bf5a62161901142d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Creating volume 01d5f394-5e2f-4fba-8c22-9938fc60c2e5 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:59:16 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01d5f394-5e2f-4fba-8c22-9938fc60c2e5 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:16 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01d5f394-5e2f-4fba-8c22-9938fc60c2e5 1073741824 Sep 04 15:59:16 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:16 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2e991a0c-04fa-40d4-b480-b7e3ba6b4199" returned: 0 in 0.335s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-quobyte-2e991a0c-04fa-40d4-b480-b7e3ba6b4199" released by "delete_volume" :: held 0.821s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:16 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Created reservations ['efd5a56a-bda7-48f2-8544-7609fb57daed', 'e82e8f3c-d9b4-497b-868b-930a99323252', 'cd51b6ec-a1f8-47ed-8e91-746794d80fa8', '03653f51-9510-46f0-a3e8-92a995846f92'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:17 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:59:17 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:59:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:17 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:59:17 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:17 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01d5f394-5e2f-4fba-8c22-9938fc60c2e5 1073741824" returned: 0 in 0.467s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01d5f394-5e2f-4fba-8c22-9938fc60c2e5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:17 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01d5f394-5e2f-4fba-8c22-9938fc60c2e5 Sep 04 15:59:17 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:17 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.298s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:17 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:17 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Deleted volume successfully. Sep 04 15:59:17 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed61b032-1538-4579-9ddd-bc14fff13695 tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-2e991a0c-04fa-40d4-b480-b7e3ba6b4199-delete_volume" released by "delete_volume" :: held 5.073s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:17 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01d5f394-5e2f-4fba-8c22-9938fc60c2e5" returned: 0 in 0.273s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:17 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:59:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7a55e2-dcbc-4ec0-b4fd-b5310e8ffadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01d5f394-5e2f-4fba-8c22-9938fc60c2e5', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c617ec-2b57-45a9-ba21-0319ab7337d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:17 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Volume volume-01d5f394-5e2f-4fba-8c22-9938fc60c2e5 (01d5f394-5e2f-4fba-8c22-9938fc60c2e5): created successfully Sep 04 15:59:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c617ec-2b57-45a9-ba21-0319ab7337d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Flow 'volume_create_manager' (9eb6c36b-a733-4aaa-8cd0-ccb642335c1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:17 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-f71e77f7-b907-4a14-ace5-ff90c58e1572 tempest-VolumesGetTest-2047380607 None] Created volume successfully. Sep 04 15:59:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4918844a-19a2-44f4-ac72-1f4d9fee641e tempest-VolumesSnapshotListTestJSON-2123040737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4918844a-19a2-44f4-ac72-1f4d9fee641e tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:17 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-4918844a-19a2-44f4-ac72-1f4d9fee641e tempest-VolumesSnapshotListTestJSON-2123040737 None] Creating offline snapshot 725d8112-b35c-4b2c-9302-4ec2e9e4227c of volume b0091f9b-b4f6-4a53-94ae-0e4b4863b41c {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:59:17 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90d2ea8-5f24-4e46-b022-e0ae951a35c1]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4918844a-19a2-44f4-ac72-1f4d9fee641e tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:17 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8 Sep 04 15:59:17 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:18 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4918844a-19a2-44f4-ac72-1f4d9fee641e tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8" returned: 0 in 0.392s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-4918844a-19a2-44f4-ac72-1f4d9fee641e tempest-VolumesSnapshotListTestJSON-2123040737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:59:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4918844a-19a2-44f4-ac72-1f4d9fee641e tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:18 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c 1G Sep 04 15:59:18 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:18 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Flow 'volume_create_manager' (82d427d9-43ee-46be-8c96-3d6d9639e961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f193cd94-190d-499b-9bd3-e57ef952c1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f193cd94-190d-499b-9bd3-e57ef952c1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-934214858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e47c84bc-b858-47ab-a4da-034be203e46e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd51b0d07554481804347d221410fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:18Z,use_quota=True,user_id='38ed0ec14ae243268435d798ff85f83c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (466d584a-c516-44f4-9712-74d30a2edec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (466d584a-c516-44f4-9712-74d30a2edec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d4dbfc-4f60-4197-8c3a-5fea3479627c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d4dbfc-4f60-4197-8c3a-5fea3479627c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e47c84bc-b858-47ab-a4da-034be203e46e', 'volume_name': 'volume-e47c84bc-b858-47ab-a4da-034be203e46e', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5c4fff-6cb0-4f9d-811d-1bf75c228b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5c4fff-6cb0-4f9d-811d-1bf75c228b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f611e1d-8929-42d6-945a-118b45a8f65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:18 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Volume e47c84bc-b858-47ab-a4da-034be203e46e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e47c84bc-b858-47ab-a4da-034be203e46e', 'volume_size': 1} Sep 04 15:59:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:18 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4918844a-19a2-44f4-ac72-1f4d9fee641e tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c 1G" returned: 0 in 0.442s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4918844a-19a2-44f4-ac72-1f4d9fee641e tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:18 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c Sep 04 15:59:18 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:18 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4918844a-19a2-44f4-ac72-1f4d9fee641e tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c" returned: 0 in 0.321s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:18 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-4918844a-19a2-44f4-ac72-1f4d9fee641e tempest-VolumesSnapshotListTestJSON-2123040737 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c is being set with open permissions: ugo+rw Sep 04 15:59:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4918844a-19a2-44f4-ac72-1f4d9fee641e tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:18 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c Sep 04 15:59:18 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:19 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4918844a-19a2-44f4-ac72-1f4d9fee641e tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c" returned: 0 in 0.240s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4918844a-19a2-44f4-ac72-1f4d9fee641e tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.501s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.660s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-934214858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e47c84bc-b858-47ab-a4da-034be203e46e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd51b0d07554481804347d221410fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:18Z,use_quota=True,user_id='38ed0ec14ae243268435d798ff85f83c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Creating volume e47c84bc-b858-47ab-a4da-034be203e46e {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:59:19 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:19 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e 1073741824 Sep 04 15:59:19 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:19 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-4918844a-19a2-44f4-ac72-1f4d9fee641e tempest-VolumesSnapshotListTestJSON-2123040737 None] Create snapshot completed successfully Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Flow 'volume_create_manager' (72c4579e-c1c7-4e62-a9d4-abb3b2a2e375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48342ecb-52ca-4ad8-94f0-a9c3545cc6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48342ecb-52ca-4ad8-94f0-a9c3545cc6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-668054328',display_name='tempest-VolumesGetTest-Volume-1907827340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda130e2-af0e-4d1a-bedb-376ae143f4dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e958005d63114a308a1fe83ce485f5f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:19Z,use_quota=True,user_id='12336b3bfc7a4918bf5a62161901142d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c935361-065b-43e4-aa67-c54e118e8a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c935361-065b-43e4-aa67-c54e118e8a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67f0caed-9477-49d7-a393-2001b8290898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67f0caed-9477-49d7-a393-2001b8290898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cda130e2-af0e-4d1a-bedb-376ae143f4dc', 'volume_name': 'volume-cda130e2-af0e-4d1a-bedb-376ae143f4dc', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13bdd688-e57a-4cdf-b8f4-3478a80ac76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13bdd688-e57a-4cdf-b8f4-3478a80ac76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47bca119-ad6c-49af-b530-3300d6edbd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:19 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Volume cda130e2-af0e-4d1a-bedb-376ae143f4dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cda130e2-af0e-4d1a-bedb-376ae143f4dc', 'volume_size': 1} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:19 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e 1073741824" returned: 0 in 0.424s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:19 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e Sep 04 15:59:19 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:19 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e" returned: 0 in 0.253s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.360s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-668054328',display_name='tempest-VolumesGetTest-Volume-1907827340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda130e2-af0e-4d1a-bedb-376ae143f4dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e958005d63114a308a1fe83ce485f5f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:19Z,use_quota=True,user_id='12336b3bfc7a4918bf5a62161901142d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Creating volume cda130e2-af0e-4d1a-bedb-376ae143f4dc {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:59:19 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cda130e2-af0e-4d1a-bedb-376ae143f4dc 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:19 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cda130e2-af0e-4d1a-bedb-376ae143f4dc 1073741824 Sep 04 15:59:19 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f611e1d-8929-42d6-945a-118b45a8f65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e47c84bc-b858-47ab-a4da-034be203e46e', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e0956d1-c9bc-4801-b71c-f394e3c72993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:19 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Volume volume-e47c84bc-b858-47ab-a4da-034be203e46e (e47c84bc-b858-47ab-a4da-034be203e46e): created successfully Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e0956d1-c9bc-4801-b71c-f394e3c72993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Flow 'volume_create_manager' (82d427d9-43ee-46be-8c96-3d6d9639e961) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-266d57e3-ec7b-486b-9888-2120bd95332b tempest-VolumesSnapshotListTestJSON-2123040737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:19 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-d05d6d05-e1a0-491f-969a-3233e2c07cc6 tempest-VolumesDeleteCascade-1571857455 None] Created volume successfully. Sep 04 15:59:20 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cda130e2-af0e-4d1a-bedb-376ae143f4dc 1073741824" returned: 0 in 0.397s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cda130e2-af0e-4d1a-bedb-376ae143f4dc {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:20 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cda130e2-af0e-4d1a-bedb-376ae143f4dc Sep 04 15:59:20 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:20 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cda130e2-af0e-4d1a-bedb-376ae143f4dc" returned: 0 in 0.259s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:20 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:59:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-266d57e3-ec7b-486b-9888-2120bd95332b tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.620s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:20 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-266d57e3-ec7b-486b-9888-2120bd95332b tempest-VolumesSnapshotListTestJSON-2123040737 None] Creating offline snapshot 765c4a9a-f697-4b45-88aa-4e986fec77ae of volume b0091f9b-b4f6-4a53-94ae-0e4b4863b41c {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:59:20 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47bca119-ad6c-49af-b530-3300d6edbd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cda130e2-af0e-4d1a-bedb-376ae143f4dc', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:20 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6a947d-e6cd-4a2a-b2f4-321331bb804a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:20 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb8d2a3-8b20-4a5d-8054-b2ab3d3dba63]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-266d57e3-ec7b-486b-9888-2120bd95332b tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:20 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Volume volume-cda130e2-af0e-4d1a-bedb-376ae143f4dc (cda130e2-af0e-4d1a-bedb-376ae143f4dc): created successfully Sep 04 15:59:20 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6a947d-e6cd-4a2a-b2f4-321331bb804a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:20 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Flow 'volume_create_manager' (72c4579e-c1c7-4e62-a9d4-abb3b2a2e375) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4fba2076-126e-4144-985e-49bdbf7b3ef8 tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:20 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-e92ed296-904b-4a03-b6b3-8634d6993eca tempest-VolumesGetTest-2047380607 None] Created volume successfully. Sep 04 15:59:20 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c Sep 04 15:59:20 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:21 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-266d57e3-ec7b-486b-9888-2120bd95332b tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c" returned: 0 in 0.355s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:21 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-266d57e3-ec7b-486b-9888-2120bd95332b tempest-VolumesSnapshotListTestJSON-2123040737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:59:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-266d57e3-ec7b-486b-9888-2120bd95332b tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.765c4a9a-f697-4b45-88aa-4e986fec77ae 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:21 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.765c4a9a-f697-4b45-88aa-4e986fec77ae 1G Sep 04 15:59:21 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:21 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-266d57e3-ec7b-486b-9888-2120bd95332b tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.765c4a9a-f697-4b45-88aa-4e986fec77ae 1G" returned: 0 in 0.425s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-266d57e3-ec7b-486b-9888-2120bd95332b tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.765c4a9a-f697-4b45-88aa-4e986fec77ae {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:21 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.765c4a9a-f697-4b45-88aa-4e986fec77ae Sep 04 15:59:21 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-729b9fdc-5735-4787-9d3f-2f2207d7e0a1 tempest-VolumesGetTest-2047380607 None] Acquiring lock "cinder-cda130e2-af0e-4d1a-bedb-376ae143f4dc-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-729b9fdc-5735-4787-9d3f-2f2207d7e0a1 tempest-VolumesGetTest-2047380607 None] Lock "cinder-cda130e2-af0e-4d1a-bedb-376ae143f4dc-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-729b9fdc-5735-4787-9d3f-2f2207d7e0a1 tempest-VolumesGetTest-2047380607 None] Acquiring lock "cinder-quobyte-cda130e2-af0e-4d1a-bedb-376ae143f4dc" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-729b9fdc-5735-4787-9d3f-2f2207d7e0a1 tempest-VolumesGetTest-2047380607 None] Lock "cinder-quobyte-cda130e2-af0e-4d1a-bedb-376ae143f4dc" acquired by "delete_volume" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:21 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b7d1df-0304-4adb-8242-0cd8dab4f022]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-729b9fdc-5735-4787-9d3f-2f2207d7e0a1 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cda130e2-af0e-4d1a-bedb-376ae143f4dc {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:21 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-266d57e3-ec7b-486b-9888-2120bd95332b tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.765c4a9a-f697-4b45-88aa-4e986fec77ae" returned: 0 in 0.356s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:21 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-266d57e3-ec7b-486b-9888-2120bd95332b tempest-VolumesSnapshotListTestJSON-2123040737 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.765c4a9a-f697-4b45-88aa-4e986fec77ae is being set with open permissions: ugo+rw Sep 04 15:59:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-266d57e3-ec7b-486b-9888-2120bd95332b tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.765c4a9a-f697-4b45-88aa-4e986fec77ae {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:21 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.765c4a9a-f697-4b45-88aa-4e986fec77ae Sep 04 15:59:21 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:21 devstack sudo[99788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cda130e2-af0e-4d1a-bedb-376ae143f4dc Sep 04 15:59:21 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:22 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-266d57e3-ec7b-486b-9888-2120bd95332b tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.765c4a9a-f697-4b45-88aa-4e986fec77ae" returned: 0 in 0.260s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-266d57e3-ec7b-486b-9888-2120bd95332b tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.516s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4fba2076-126e-4144-985e-49bdbf7b3ef8 tempest-VolumesDeleteCascade-1571857455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.337s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-4fba2076-126e-4144-985e-49bdbf7b3ef8 tempest-VolumesDeleteCascade-1571857455 None] Creating offline snapshot 802280ab-3206-430b-97f5-3cfb416fea83 of volume e47c84bc-b858-47ab-a4da-034be203e46e {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:59:22 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-266d57e3-ec7b-486b-9888-2120bd95332b tempest-VolumesSnapshotListTestJSON-2123040737 None] Create snapshot completed successfully Sep 04 15:59:22 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ad1614-153b-4800-b1ce-f6dcc37dd761]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4fba2076-126e-4144-985e-49bdbf7b3ef8 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:22 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-729b9fdc-5735-4787-9d3f-2f2207d7e0a1 tempest-VolumesGetTest-2047380607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cda130e2-af0e-4d1a-bedb-376ae143f4dc" returned: 0 in 0.380s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-729b9fdc-5735-4787-9d3f-2f2207d7e0a1 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cda130e2-af0e-4d1a-bedb-376ae143f4dc {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:22 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cda130e2-af0e-4d1a-bedb-376ae143f4dc Sep 04 15:59:22 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:22 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e Sep 04 15:59:22 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:22 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-729b9fdc-5735-4787-9d3f-2f2207d7e0a1 tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cda130e2-af0e-4d1a-bedb-376ae143f4dc" returned: 0 in 0.239s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-729b9fdc-5735-4787-9d3f-2f2207d7e0a1 tempest-VolumesGetTest-2047380607 None] Lock "cinder-quobyte-cda130e2-af0e-4d1a-bedb-376ae143f4dc" released by "delete_volume" :: held 0.666s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:22 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-729b9fdc-5735-4787-9d3f-2f2207d7e0a1 tempest-VolumesGetTest-2047380607 None] Created reservations ['392456c0-8756-4329-aa01-5a3661999771', 'a0901886-ec10-4023-a092-4e557397fdd2', 'd0bc954e-fbef-4e47-94ed-170183f4f26f', '50a069a9-c876-44f8-a84a-6231a476b5e9'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-729b9fdc-5735-4787-9d3f-2f2207d7e0a1 tempest-VolumesGetTest-2047380607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-729b9fdc-5735-4787-9d3f-2f2207d7e0a1 tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-729b9fdc-5735-4787-9d3f-2f2207d7e0a1 tempest-VolumesGetTest-2047380607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:59:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-729b9fdc-5735-4787-9d3f-2f2207d7e0a1 tempest-VolumesGetTest-2047380607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:59:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-729b9fdc-5735-4787-9d3f-2f2207d7e0a1 tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-729b9fdc-5735-4787-9d3f-2f2207d7e0a1 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:22 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4fba2076-126e-4144-985e-49bdbf7b3ef8 tempest-VolumesDeleteCascade-1571857455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e" returned: 0 in 0.398s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4fba2076-126e-4144-985e-49bdbf7b3ef8 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.802280ab-3206-430b-97f5-3cfb416fea83 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:22 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:59:22 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:22 devstack sudo[99805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.802280ab-3206-430b-97f5-3cfb416fea83 1G Sep 04 15:59:22 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:22 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-729b9fdc-5735-4787-9d3f-2f2207d7e0a1 tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.261s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:22 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-729b9fdc-5735-4787-9d3f-2f2207d7e0a1 tempest-VolumesGetTest-2047380607 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:22 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-729b9fdc-5735-4787-9d3f-2f2207d7e0a1 tempest-VolumesGetTest-2047380607 None] Deleted volume successfully. Sep 04 15:59:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-729b9fdc-5735-4787-9d3f-2f2207d7e0a1 tempest-VolumesGetTest-2047380607 None] Lock "cinder-cda130e2-af0e-4d1a-bedb-376ae143f4dc-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6d237da7-79b7-46ae-b3cd-dd495aa0995d tempest-VolumesGetTest-2047380607 None] Acquiring lock "cinder-01d5f394-5e2f-4fba-8c22-9938fc60c2e5-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6d237da7-79b7-46ae-b3cd-dd495aa0995d tempest-VolumesGetTest-2047380607 None] Lock "cinder-01d5f394-5e2f-4fba-8c22-9938fc60c2e5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6d237da7-79b7-46ae-b3cd-dd495aa0995d tempest-VolumesGetTest-2047380607 None] Acquiring lock "cinder-quobyte-01d5f394-5e2f-4fba-8c22-9938fc60c2e5" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6d237da7-79b7-46ae-b3cd-dd495aa0995d tempest-VolumesGetTest-2047380607 None] Lock "cinder-quobyte-01d5f394-5e2f-4fba-8c22-9938fc60c2e5" acquired by "delete_volume" :: waited 0.025s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:23 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb01fec-099f-464d-85e6-4506cf5b2fb6]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6d237da7-79b7-46ae-b3cd-dd495aa0995d tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01d5f394-5e2f-4fba-8c22-9938fc60c2e5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:23 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4fba2076-126e-4144-985e-49bdbf7b3ef8 tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.802280ab-3206-430b-97f5-3cfb416fea83 1G" returned: 0 in 0.541s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4fba2076-126e-4144-985e-49bdbf7b3ef8 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e47c84bc-b858-47ab-a4da-034be203e46e -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.802280ab-3206-430b-97f5-3cfb416fea83 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:23 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e47c84bc-b858-47ab-a4da-034be203e46e -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.802280ab-3206-430b-97f5-3cfb416fea83 Sep 04 15:59:23 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:23 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01d5f394-5e2f-4fba-8c22-9938fc60c2e5 Sep 04 15:59:23 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:23 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4fba2076-126e-4144-985e-49bdbf7b3ef8 tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e47c84bc-b858-47ab-a4da-034be203e46e -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.802280ab-3206-430b-97f5-3cfb416fea83" returned: 0 in 0.321s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:23 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-4fba2076-126e-4144-985e-49bdbf7b3ef8 tempest-VolumesDeleteCascade-1571857455 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.802280ab-3206-430b-97f5-3cfb416fea83 is being set with open permissions: ugo+rw Sep 04 15:59:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4fba2076-126e-4144-985e-49bdbf7b3ef8 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.802280ab-3206-430b-97f5-3cfb416fea83 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:23 devstack sudo[99821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.802280ab-3206-430b-97f5-3cfb416fea83 Sep 04 15:59:23 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:23 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6d237da7-79b7-46ae-b3cd-dd495aa0995d tempest-VolumesGetTest-2047380607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01d5f394-5e2f-4fba-8c22-9938fc60c2e5" returned: 0 in 0.431s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6d237da7-79b7-46ae-b3cd-dd495aa0995d tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01d5f394-5e2f-4fba-8c22-9938fc60c2e5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:23 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01d5f394-5e2f-4fba-8c22-9938fc60c2e5 Sep 04 15:59:23 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:23 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4fba2076-126e-4144-985e-49bdbf7b3ef8 tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.802280ab-3206-430b-97f5-3cfb416fea83" returned: 0 in 0.263s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4fba2076-126e-4144-985e-49bdbf7b3ef8 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:23 devstack sudo[99828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.info Sep 04 15:59:23 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:23 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6d237da7-79b7-46ae-b3cd-dd495aa0995d tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01d5f394-5e2f-4fba-8c22-9938fc60c2e5" returned: 0 in 0.289s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6d237da7-79b7-46ae-b3cd-dd495aa0995d tempest-VolumesGetTest-2047380607 None] Lock "cinder-quobyte-01d5f394-5e2f-4fba-8c22-9938fc60c2e5" released by "delete_volume" :: held 0.771s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:23 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-6d237da7-79b7-46ae-b3cd-dd495aa0995d tempest-VolumesGetTest-2047380607 None] Created reservations ['7de3b4ba-81c5-4f36-a342-17aee8c5fddd', 'b9a0b006-daf5-43c6-bb2b-3c59cc4607e6', '30229200-c233-489d-b723-697e319fc20d', '8d557736-ce2d-4e91-88d9-104273eaf462'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6d237da7-79b7-46ae-b3cd-dd495aa0995d tempest-VolumesGetTest-2047380607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6d237da7-79b7-46ae-b3cd-dd495aa0995d tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:23 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-6d237da7-79b7-46ae-b3cd-dd495aa0995d tempest-VolumesGetTest-2047380607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:59:23 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-6d237da7-79b7-46ae-b3cd-dd495aa0995d tempest-VolumesGetTest-2047380607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:59:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6d237da7-79b7-46ae-b3cd-dd495aa0995d tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6d237da7-79b7-46ae-b3cd-dd495aa0995d tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-132e8f52-8fc3-413f-b397-d268c05daa30 tempest-VolumesSnapshotListTestJSON-2123040737 None] Acquiring lock "cinder-765c4a9a-f697-4b45-88aa-4e986fec77ae-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:23 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:59:23 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-132e8f52-8fc3-413f-b397-d268c05daa30 tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "cinder-765c4a9a-f697-4b45-88aa-4e986fec77ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-132e8f52-8fc3-413f-b397-d268c05daa30 tempest-VolumesSnapshotListTestJSON-2123040737 None] Acquiring lock "cinder-quobyte-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-132e8f52-8fc3-413f-b397-d268c05daa30 tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "cinder-quobyte-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-132e8f52-8fc3-413f-b397-d268c05daa30 tempest-VolumesSnapshotListTestJSON-2123040737 None] Acquiring lock "cinder-quobyte-765c4a9a-f697-4b45-88aa-4e986fec77ae" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-132e8f52-8fc3-413f-b397-d268c05daa30 tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "cinder-quobyte-765c4a9a-f697-4b45-88aa-4e986fec77ae" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-132e8f52-8fc3-413f-b397-d268c05daa30 tempest-VolumesSnapshotListTestJSON-2123040737 None] Deleting offline snapshot 765c4a9a-f697-4b45-88aa-4e986fec77ae of volume b0091f9b-b4f6-4a53-94ae-0e4b4863b41c {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:59:24 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-132e8f52-8fc3-413f-b397-d268c05daa30 tempest-VolumesSnapshotListTestJSON-2123040737 None] snapshot_file for this snap is: volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.765c4a9a-f697-4b45-88aa-4e986fec77ae {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4fba2076-126e-4144-985e-49bdbf7b3ef8 tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.info" returned: 0 in 0.372s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:24 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-4fba2076-126e-4144-985e-49bdbf7b3ef8 tempest-VolumesDeleteCascade-1571857455 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.info is being set with open permissions: ugo+rw Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4fba2076-126e-4144-985e-49bdbf7b3ef8 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7d5573-b51c-401a-996c-074e3a5f364c]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:24 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.info Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-132e8f52-8fc3-413f-b397-d268c05daa30 tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.765c4a9a-f697-4b45-88aa-4e986fec77ae {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:24 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:24 devstack sudo[99837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.765c4a9a-f697-4b45-88aa-4e986fec77ae Sep 04 15:59:24 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:24 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4fba2076-126e-4144-985e-49bdbf7b3ef8 tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.info" returned: 0 in 0.312s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:24 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4fba2076-126e-4144-985e-49bdbf7b3ef8 tempest-VolumesDeleteCascade-1571857455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.326s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6d237da7-79b7-46ae-b3cd-dd495aa0995d tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.491s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-6d237da7-79b7-46ae-b3cd-dd495aa0995d tempest-VolumesGetTest-2047380607 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:24 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-6d237da7-79b7-46ae-b3cd-dd495aa0995d tempest-VolumesGetTest-2047380607 None] Deleted volume successfully. Sep 04 15:59:24 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-4fba2076-126e-4144-985e-49bdbf7b3ef8 tempest-VolumesDeleteCascade-1571857455 None] Create snapshot completed successfully Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6d237da7-79b7-46ae-b3cd-dd495aa0995d tempest-VolumesGetTest-2047380607 None] Lock "cinder-01d5f394-5e2f-4fba-8c22-9938fc60c2e5-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:24 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-132e8f52-8fc3-413f-b397-d268c05daa30 tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.765c4a9a-f697-4b45-88aa-4e986fec77ae" returned: 0 in 0.471s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-132e8f52-8fc3-413f-b397-d268c05daa30 tempest-VolumesSnapshotListTestJSON-2123040737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf6a51c-2773-46a2-8c85-b74a91069309]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-132e8f52-8fc3-413f-b397-d268c05daa30 tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:24 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c Sep 04 15:59:24 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Flow 'volume_create_manager' (a33d4a0b-b2c4-44b3-a906-2be54ad205e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86113ef8-00fc-40be-8506-75d2a123153c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86113ef8-00fc-40be-8506-75d2a123153c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1086583201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b8d96d-37fe-4929-bdfe-14299b32462d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e958005d63114a308a1fe83ce485f5f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:25Z,use_quota=True,user_id='12336b3bfc7a4918bf5a62161901142d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4acacd16-6da3-43a9-9761-fe60d737bab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4acacd16-6da3-43a9-9761-fe60d737bab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e52577b-eb1a-4216-bd19-0bd820bcd474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e52577b-eb1a-4216-bd19-0bd820bcd474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1b8d96d-37fe-4929-bdfe-14299b32462d', 'volume_name': 'volume-d1b8d96d-37fe-4929-bdfe-14299b32462d', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f4ea3de-29fe-44c9-bdd9-a40556f97bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f4ea3de-29fe-44c9-bdd9-a40556f97bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93775e09-03af-4f9d-90d5-1a3b0fbb0ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:24 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Volume d1b8d96d-37fe-4929-bdfe-14299b32462d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1b8d96d-37fe-4929-bdfe-14299b32462d', 'volume_size': 1} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1086583201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b8d96d-37fe-4929-bdfe-14299b32462d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e958005d63114a308a1fe83ce485f5f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:25Z,use_quota=True,user_id='12336b3bfc7a4918bf5a62161901142d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Creating volume d1b8d96d-37fe-4929-bdfe-14299b32462d {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:59:24 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:59:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:24 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d 1073741824 Sep 04 15:59:24 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:25 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-132e8f52-8fc3-413f-b397-d268c05daa30 tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c" returned: 0 in 0.444s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-132e8f52-8fc3-413f-b397-d268c05daa30 tempest-VolumesSnapshotListTestJSON-2123040737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-132e8f52-8fc3-413f-b397-d268c05daa30 tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.765c4a9a-f697-4b45-88aa-4e986fec77ae {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:25 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.765c4a9a-f697-4b45-88aa-4e986fec77ae Sep 04 15:59:25 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:25 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d 1073741824" returned: 0 in 0.495s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:25 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d Sep 04 15:59:25 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Flow 'volume_create_manager' (31f83c5a-1ade-46ad-a44f-acbed6e5625c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:25 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7605e5-76ca-44fc-846f-a012186a0740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-132e8f52-8fc3-413f-b397-d268c05daa30 tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.765c4a9a-f697-4b45-88aa-4e986fec77ae" returned: 0 in 0.524s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-132e8f52-8fc3-413f-b397-d268c05daa30 tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.765c4a9a-f697-4b45-88aa-4e986fec77ae {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7605e5-76ca-44fc-846f-a012186a0740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1732899262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c438f9c5-0724-41e7-bbb8-dfc27e47365e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd51b0d07554481804347d221410fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=802280ab-3206-430b-97f5-3cfb416fea83,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:25Z,use_quota=True,user_id='38ed0ec14ae243268435d798ff85f83c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad39af22-f7e3-4db7-b68d-1f658ab69db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:25 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.765c4a9a-f697-4b45-88aa-4e986fec77ae Sep 04 15:59:25 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad39af22-f7e3-4db7-b68d-1f658ab69db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e3b6027-9f46-4122-84bd-2151b78e60f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e3b6027-9f46-4122-84bd-2151b78e60f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c438f9c5-0724-41e7-bbb8-dfc27e47365e', 'volume_name': 'volume-c438f9c5-0724-41e7-bbb8-dfc27e47365e', 'volume_size': 1, 'snapshot_id': '802280ab-3206-430b-97f5-3cfb416fea83'}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:25 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c01ccbc-fa8b-478c-9ec7-8e7113ce9b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c01ccbc-fa8b-478c-9ec7-8e7113ce9b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d593e5e6-4774-4ddf-810f-0dcfeecbc802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:25 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Volume c438f9c5-0724-41e7-bbb8-dfc27e47365e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c438f9c5-0724-41e7-bbb8-dfc27e47365e', 'volume_size': 1, 'snapshot_id': '802280ab-3206-430b-97f5-3cfb416fea83'} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d" returned: 0 in 0.288s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "cinder-quobyte-802280ab-3206-430b-97f5-3cfb416fea83-c438f9c5-0724-41e7-bbb8-dfc27e47365e" by "_create_volume_from_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93775e09-03af-4f9d-90d5-1a3b0fbb0ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1b8d96d-37fe-4929-bdfe-14299b32462d', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c51309e6-5a71-4049-8ead-a59684b2666a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-quobyte-802280ab-3206-430b-97f5-3cfb416fea83-c438f9c5-0724-41e7-bbb8-dfc27e47365e" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Creating volume c438f9c5-0724-41e7-bbb8-dfc27e47365e from snapshot 802280ab-3206-430b-97f5-3cfb416fea83 {{(pid=87490) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "cinder-quobyte-c438f9c5-0724-41e7-bbb8-dfc27e47365e" by "_copy_volume_from_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:25 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Volume volume-d1b8d96d-37fe-4929-bdfe-14299b32462d (d1b8d96d-37fe-4929-bdfe-14299b32462d): created successfully Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c51309e6-5a71-4049-8ead-a59684b2666a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Flow 'volume_create_manager' (a33d4a0b-b2c4-44b3-a906-2be54ad205e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-quobyte-c438f9c5-0724-41e7-bbb8-dfc27e47365e" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] snapshot: 802280ab-3206-430b-97f5-3cfb416fea83, volume: c438f9c5-0724-41e7-bbb8-dfc27e47365e, {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 15:59:25 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-7d4932d0-b3ce-4509-b26f-ba2fd93a2b48 tempest-VolumesGetTest-2047380607 None] Created volume successfully. Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[e469793d-f65d-4e5d-9146-fc8b74c27cd8]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.802280ab-3206-430b-97f5-3cfb416fea83 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:25 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-132e8f52-8fc3-413f-b397-d268c05daa30 tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.765c4a9a-f697-4b45-88aa-4e986fec77ae" returned: 0 in 0.323s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:25 devstack sudo[99867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.802280ab-3206-430b-97f5-3cfb416fea83 Sep 04 15:59:25 devstack sudo[99867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-132e8f52-8fc3-413f-b397-d268c05daa30 tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "cinder-quobyte-765c4a9a-f697-4b45-88aa-4e986fec77ae" released by "_delete_snapshot" :: held 1.897s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:25 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-132e8f52-8fc3-413f-b397-d268c05daa30 tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "cinder-quobyte-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c" released by "delete_snapshot" :: held 1.924s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:26 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-132e8f52-8fc3-413f-b397-d268c05daa30 tempest-VolumesSnapshotListTestJSON-2123040737 None] Created reservations ['b3ad6ac6-b4a5-4d8b-a67f-fd96dbb5c2c9', 'b3f135f2-6e32-4e0a-bb5e-df8dceec6a30', '3371c4cb-162c-45af-8e57-aa34a165ff74', '9762db9d-e7d3-4833-92b7-80260070065b'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:26 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-132e8f52-8fc3-413f-b397-d268c05daa30 tempest-VolumesSnapshotListTestJSON-2123040737 None] Delete snapshot completed successfully. Sep 04 15:59:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-132e8f52-8fc3-413f-b397-d268c05daa30 tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "cinder-765c4a9a-f697-4b45-88aa-4e986fec77ae-delete_snapshot" released by "delete_snapshot" :: held 2.096s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ee3bdf06-812b-48ff-9ebe-d882fd90ed8e tempest-VolumesSnapshotListTestJSON-2123040737 None] Acquiring lock "cinder-725d8112-b35c-4b2c-9302-4ec2e9e4227c-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ee3bdf06-812b-48ff-9ebe-d882fd90ed8e tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "cinder-725d8112-b35c-4b2c-9302-4ec2e9e4227c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ee3bdf06-812b-48ff-9ebe-d882fd90ed8e tempest-VolumesSnapshotListTestJSON-2123040737 None] Acquiring lock "cinder-quobyte-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ee3bdf06-812b-48ff-9ebe-d882fd90ed8e tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "cinder-quobyte-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ee3bdf06-812b-48ff-9ebe-d882fd90ed8e tempest-VolumesSnapshotListTestJSON-2123040737 None] Acquiring lock "cinder-quobyte-725d8112-b35c-4b2c-9302-4ec2e9e4227c" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:26 devstack sudo[99867]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ee3bdf06-812b-48ff-9ebe-d882fd90ed8e tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "cinder-quobyte-725d8112-b35c-4b2c-9302-4ec2e9e4227c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:26 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-ee3bdf06-812b-48ff-9ebe-d882fd90ed8e tempest-VolumesSnapshotListTestJSON-2123040737 None] Deleting offline snapshot 725d8112-b35c-4b2c-9302-4ec2e9e4227c of volume b0091f9b-b4f6-4a53-94ae-0e4b4863b41c {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:59:26 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-ee3bdf06-812b-48ff-9ebe-d882fd90ed8e tempest-VolumesSnapshotListTestJSON-2123040737 None] snapshot_file for this snap is: volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:59:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.802280ab-3206-430b-97f5-3cfb416fea83" returned: 0 in 0.445s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:26 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e47c84bc-b858-47ab-a4da-034be203e46e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:59:26 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[300efc44-73a7-49c8-b29f-ae1519eaca3b]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ee3bdf06-812b-48ff-9ebe-d882fd90ed8e tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:26 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[05711501-095c-4073-b68d-03fa2765ae4b]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:26 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e Sep 04 15:59:26 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:26 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c Sep 04 15:59:26 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:26 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ee3bdf06-812b-48ff-9ebe-d882fd90ed8e tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c" returned: 0 in 0.410s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:26 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-ee3bdf06-812b-48ff-9ebe-d882fd90ed8e tempest-VolumesSnapshotListTestJSON-2123040737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:59:26 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e" returned: 0 in 0.426s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:26 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 15:59:26 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Creating direct copy from snapshot {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 15:59:26 devstack cinder-volume[87490]: DEBUG cinder.utils [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Path /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c438f9c5-0724-41e7-bbb8-dfc27e47365e not found in is_blk_device check {{(pid=87490) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 15:59:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c438f9c5-0724-41e7-bbb8-dfc27e47365e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:26 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[65714217-938f-473b-aa17-48879a99795a]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ee3bdf06-812b-48ff-9ebe-d882fd90ed8e tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:26 devstack sudo[99919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c438f9c5-0724-41e7-bbb8-dfc27e47365e Sep 04 15:59:26 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:26 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8 Sep 04 15:59:26 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:27 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ee3bdf06-812b-48ff-9ebe-d882fd90ed8e tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8" returned: 0 in 0.579s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:27 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-ee3bdf06-812b-48ff-9ebe-d882fd90ed8e tempest-VolumesSnapshotListTestJSON-2123040737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:59:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ee3bdf06-812b-48ff-9ebe-d882fd90ed8e tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:27 devstack sudo[99935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c Sep 04 15:59:27 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:27 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Flow 'volume_create_manager' (70566168-5417-4186-8996-39cb9449c37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75bbcf1b-4cec-4bf6-8a6c-109a4a379c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75bbcf1b-4cec-4bf6-8a6c-109a4a379c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-389627932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fafae48-c73a-4c96-8283-6280fc452ded,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e958005d63114a308a1fe83ce485f5f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d1b8d96d-37fe-4929-bdfe-14299b32462d,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:28Z,use_quota=True,user_id='12336b3bfc7a4918bf5a62161901142d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb05d09-0bd6-44ce-94af-a996b2184ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb05d09-0bd6-44ce-94af-a996b2184ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14fb6a7e-b859-4fd7-bf27-9e2a7ebbcc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14fb6a7e-b859-4fd7-bf27-9e2a7ebbcc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3fafae48-c73a-4c96-8283-6280fc452ded', 'volume_name': 'volume-3fafae48-c73a-4c96-8283-6280fc452ded', 'volume_size': 1, 'source_volid': 'd1b8d96d-37fe-4929-bdfe-14299b32462d', 'source_volstatus': 'available'}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef7ae6d3-3205-472a-b2a7-39083130837d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef7ae6d3-3205-472a-b2a7-39083130837d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c631608-03a4-4380-9749-667b20a0bc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:27 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Volume 3fafae48-c73a-4c96-8283-6280fc452ded: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3fafae48-c73a-4c96-8283-6280fc452ded', 'volume_size': 1, 'source_volid': 'd1b8d96d-37fe-4929-bdfe-14299b32462d', 'source_volstatus': 'available'} Sep 04 15:59:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:28 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ee3bdf06-812b-48ff-9ebe-d882fd90ed8e tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c" returned: 0 in 0.897s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ee3bdf06-812b-48ff-9ebe-d882fd90ed8e tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:28 devstack sudo[99944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c Sep 04 15:59:28 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:28 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ee3bdf06-812b-48ff-9ebe-d882fd90ed8e tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.725d8112-b35c-4b2c-9302-4ec2e9e4227c" returned: 0 in 0.524s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:28 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ee3bdf06-812b-48ff-9ebe-d882fd90ed8e tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "cinder-quobyte-725d8112-b35c-4b2c-9302-4ec2e9e4227c" released by "_delete_snapshot" :: held 2.575s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:28 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ee3bdf06-812b-48ff-9ebe-d882fd90ed8e tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "cinder-quobyte-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c" released by "delete_snapshot" :: held 2.610s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:29 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-ee3bdf06-812b-48ff-9ebe-d882fd90ed8e tempest-VolumesSnapshotListTestJSON-2123040737 None] Created reservations ['218a9ac4-1b39-484c-816f-c7f457368f44', '710673c3-4fc2-429c-a286-fa98d8eb033e', 'f6d7ad1c-4744-4299-b921-fc8de7b40f25', '9e8f90d6-b1ec-4fc5-94e2-0a767bbeead4'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:29 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-ee3bdf06-812b-48ff-9ebe-d882fd90ed8e tempest-VolumesSnapshotListTestJSON-2123040737 None] Delete snapshot completed successfully. Sep 04 15:59:29 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ee3bdf06-812b-48ff-9ebe-d882fd90ed8e tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "cinder-725d8112-b35c-4b2c-9302-4ec2e9e4227c-delete_snapshot" released by "delete_snapshot" :: held 3.025s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:29 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cf4f07b4-250b-4c1a-8c18-463b675e42c8 tempest-VolumesSnapshotListTestJSON-2123040737 None] Acquiring lock "cinder-d433bfbe-0ccb-4db7-ad67-e19ea27716c8-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:29 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cf4f07b4-250b-4c1a-8c18-463b675e42c8 tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "cinder-d433bfbe-0ccb-4db7-ad67-e19ea27716c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:29 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cf4f07b4-250b-4c1a-8c18-463b675e42c8 tempest-VolumesSnapshotListTestJSON-2123040737 None] Acquiring lock "cinder-quobyte-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:29 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cf4f07b4-250b-4c1a-8c18-463b675e42c8 tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "cinder-quobyte-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:29 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cf4f07b4-250b-4c1a-8c18-463b675e42c8 tempest-VolumesSnapshotListTestJSON-2123040737 None] Acquiring lock "cinder-quobyte-d433bfbe-0ccb-4db7-ad67-e19ea27716c8" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:29 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cf4f07b4-250b-4c1a-8c18-463b675e42c8 tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "cinder-quobyte-d433bfbe-0ccb-4db7-ad67-e19ea27716c8" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:29 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-cf4f07b4-250b-4c1a-8c18-463b675e42c8 tempest-VolumesSnapshotListTestJSON-2123040737 None] Deleting offline snapshot d433bfbe-0ccb-4db7-ad67-e19ea27716c8 of volume b0091f9b-b4f6-4a53-94ae-0e4b4863b41c {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:59:29 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-cf4f07b4-250b-4c1a-8c18-463b675e42c8 tempest-VolumesSnapshotListTestJSON-2123040737 None] snapshot_file for this snap is: volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:59:29 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9e8c93-1f43-47ab-a378-b28162b9f369]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cf4f07b4-250b-4c1a-8c18-463b675e42c8 tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:30 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8 Sep 04 15:59:30 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:30 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cf4f07b4-250b-4c1a-8c18-463b675e42c8 tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8" returned: 0 in 0.970s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:30 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-cf4f07b4-250b-4c1a-8c18-463b675e42c8 tempest-VolumesSnapshotListTestJSON-2123040737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:59:30 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0ebdf5-c882-42b7-83d9-6dee9f6e3a11]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cf4f07b4-250b-4c1a-8c18-463b675e42c8 tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:31 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c Sep 04 15:59:31 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:31 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cf4f07b4-250b-4c1a-8c18-463b675e42c8 tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c" returned: 0 in 0.632s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cf4f07b4-250b-4c1a-8c18-463b675e42c8 tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:31 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8 Sep 04 15:59:31 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:31 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c438f9c5-0724-41e7-bbb8-dfc27e47365e" returned: 0 in 4.921s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:31 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e, size 1024.00 MB, duration 4.92 sec, destination /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c438f9c5-0724-41e7-bbb8-dfc27e47365e {{(pid=87490) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 15:59:31 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Converted 1024.00 MB image at 208.03 MB/s Sep 04 15:59:31 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c438f9c5-0724-41e7-bbb8-dfc27e47365e is being set with open permissions: ugo+rw Sep 04 15:59:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c438f9c5-0724-41e7-bbb8-dfc27e47365e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:31 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c438f9c5-0724-41e7-bbb8-dfc27e47365e Sep 04 15:59:31 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:31 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cf4f07b4-250b-4c1a-8c18-463b675e42c8 tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8" returned: 0 in 0.408s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cf4f07b4-250b-4c1a-8c18-463b675e42c8 tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:31 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8 Sep 04 15:59:31 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:31 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c438f9c5-0724-41e7-bbb8-dfc27e47365e" returned: 0 in 0.255s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-quobyte-c438f9c5-0724-41e7-bbb8-dfc27e47365e" released by "_copy_volume_from_snapshot" :: held 6.151s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:31 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=145,cinder:INSERT=35,cinder:UPDATE=164,cinder:DELETE=15 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:59:31 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:INSERT=51,cinder:UPDATE=171,cinder:SELECT=132,cinder:DELETE=15 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 15:59:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-quobyte-802280ab-3206-430b-97f5-3cfb416fea83-c438f9c5-0724-41e7-bbb8-dfc27e47365e" released by "_create_volume_from_snapshot" :: held 6.257s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.291s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.947s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:31 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Cloning volume d1b8d96d-37fe-4929-bdfe-14299b32462d to volume 3fafae48-c73a-4c96-8283-6280fc452ded Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d593e5e6-4774-4ddf-810f-0dcfeecbc802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c438f9c5-0724-41e7-bbb8-dfc27e47365e', 'volume_size': 1, 'snapshot_id': '802280ab-3206-430b-97f5-3cfb416fea83'}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (368c6e8e-9c40-4fa9-bbf8-665ef1046581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Creating offline snapshot fc22c583-57db-4a4d-9831-88c856d85c6a of volume d1b8d96d-37fe-4929-bdfe-14299b32462d {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 15:59:32 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Volume volume-c438f9c5-0724-41e7-bbb8-dfc27e47365e (c438f9c5-0724-41e7-bbb8-dfc27e47365e): created successfully Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (368c6e8e-9c40-4fa9-bbf8-665ef1046581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Flow 'volume_create_manager' (31f83c5a-1ade-46ad-a44f-acbed6e5625c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[db16608e-9c8d-4e27-b8e2-87f5f501d76b]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:32 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-de315ce9-018d-4266-a0ae-60cd2512e19a tempest-VolumesDeleteCascade-1571857455 None] Created volume successfully. Sep 04 15:59:32 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cf4f07b4-250b-4c1a-8c18-463b675e42c8 tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c.d433bfbe-0ccb-4db7-ad67-e19ea27716c8" returned: 0 in 0.292s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cf4f07b4-250b-4c1a-8c18-463b675e42c8 tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "cinder-quobyte-d433bfbe-0ccb-4db7-ad67-e19ea27716c8" released by "_delete_snapshot" :: held 2.543s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:32 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d Sep 04 15:59:32 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cf4f07b4-250b-4c1a-8c18-463b675e42c8 tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "cinder-quobyte-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c" released by "delete_snapshot" :: held 2.597s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-cf4f07b4-250b-4c1a-8c18-463b675e42c8 tempest-VolumesSnapshotListTestJSON-2123040737 None] Created reservations ['87566c8d-9978-427c-8057-e539e1881439', '27304a53-64e3-4132-b9a2-07aff7f0e87a', 'c7aea815-4d22-4614-b857-06597b6afc7e', 'affe173b-6de7-4f52-afad-073e77d7aed2'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "cinder-e47c84bc-b858-47ab-a4da-034be203e46e-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-e47c84bc-b858-47ab-a4da-034be203e46e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:32 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-cf4f07b4-250b-4c1a-8c18-463b675e42c8 tempest-VolumesSnapshotListTestJSON-2123040737 None] Delete snapshot completed successfully. Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cf4f07b4-250b-4c1a-8c18-463b675e42c8 tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "cinder-d433bfbe-0ccb-4db7-ad67-e19ea27716c8-delete_snapshot" released by "delete_snapshot" :: held 2.812s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Performing cascade delete. {{(pid=87490) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "cinder-802280ab-3206-430b-97f5-3cfb416fea83-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-802280ab-3206-430b-97f5-3cfb416fea83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "cinder-quobyte-e47c84bc-b858-47ab-a4da-034be203e46e" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-quobyte-e47c84bc-b858-47ab-a4da-034be203e46e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "cinder-quobyte-802280ab-3206-430b-97f5-3cfb416fea83" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-quobyte-802280ab-3206-430b-97f5-3cfb416fea83" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Deleting offline snapshot 802280ab-3206-430b-97f5-3cfb416fea83 of volume e47c84bc-b858-47ab-a4da-034be203e46e {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] snapshot_file for this snap is: volume-e47c84bc-b858-47ab-a4da-034be203e46e.802280ab-3206-430b-97f5-3cfb416fea83 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:59:32 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d" returned: 0 in 0.444s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.fc22c583-57db-4a4d-9831-88c856d85c6a 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[c901d536-f5d2-48bf-ad98-5743bd50e481]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.802280ab-3206-430b-97f5-3cfb416fea83 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:32 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.fc22c583-57db-4a4d-9831-88c856d85c6a 1G Sep 04 15:59:32 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:32 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.802280ab-3206-430b-97f5-3cfb416fea83 Sep 04 15:59:32 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:32 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.802280ab-3206-430b-97f5-3cfb416fea83" returned: 0 in 0.389s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e47c84bc-b858-47ab-a4da-034be203e46e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d00dc7c7-f92f-4e38-8d5a-df1829050c14 tempest-VolumesSnapshotListTestJSON-2123040737 None] Acquiring lock "cinder-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b81e87-0cc2-4598-ae3b-c4245436b32c]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:32 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d00dc7c7-f92f-4e38-8d5a-df1829050c14 tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "cinder-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.fc22c583-57db-4a4d-9831-88c856d85c6a 1G" returned: 0 in 0.478s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1b8d96d-37fe-4929-bdfe-14299b32462d -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.fc22c583-57db-4a4d-9831-88c856d85c6a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:33 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1b8d96d-37fe-4929-bdfe-14299b32462d -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.fc22c583-57db-4a4d-9831-88c856d85c6a Sep 04 15:59:33 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:33 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d00dc7c7-f92f-4e38-8d5a-df1829050c14 tempest-VolumesSnapshotListTestJSON-2123040737 None] Acquiring lock "cinder-quobyte-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:33 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d00dc7c7-f92f-4e38-8d5a-df1829050c14 tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "cinder-quobyte-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c" acquired by "delete_volume" :: waited 0.015s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:33 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e Sep 04 15:59:33 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:33 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fc1823-053d-4ee3-b2a9-2b41d26f9b2d]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d00dc7c7-f92f-4e38-8d5a-df1829050c14 tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:33 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c Sep 04 15:59:33 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:33 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1b8d96d-37fe-4929-bdfe-14299b32462d -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.fc22c583-57db-4a4d-9831-88c856d85c6a" returned: 0 in 0.356s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:33 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.fc22c583-57db-4a4d-9831-88c856d85c6a is being set with open permissions: ugo+rw Sep 04 15:59:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.fc22c583-57db-4a4d-9831-88c856d85c6a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:33 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.fc22c583-57db-4a4d-9831-88c856d85c6a Sep 04 15:59:33 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:33 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:33 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d00dc7c7-f92f-4e38-8d5a-df1829050c14 tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c" returned: 0 in 0.389s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d00dc7c7-f92f-4e38-8d5a-df1829050c14 tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e" returned: 0 in 0.557s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.802280ab-3206-430b-97f5-3cfb416fea83 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:33 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c Sep 04 15:59:33 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:33 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.802280ab-3206-430b-97f5-3cfb416fea83 Sep 04 15:59:33 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:33 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.fc22c583-57db-4a4d-9831-88c856d85c6a" returned: 0 in 0.264s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:33 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.info Sep 04 15:59:33 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:33 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d00dc7c7-f92f-4e38-8d5a-df1829050c14 tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c" returned: 0 in 0.264s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:33 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d00dc7c7-f92f-4e38-8d5a-df1829050c14 tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "cinder-quobyte-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c" released by "delete_volume" :: held 0.716s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:33 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-d00dc7c7-f92f-4e38-8d5a-df1829050c14 tempest-VolumesSnapshotListTestJSON-2123040737 None] Created reservations ['e8fce6a9-52c4-4a91-9623-2fcdb05886bf', '54bd6e67-d331-482a-a7b5-16ecf25e3b9d', 'da5b9c6c-9900-4a48-b6bd-834ea6859a22', '40a0bf13-3862-4abd-b81b-ca9ec04346d2'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:33 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.info" returned: 0 in 0.270s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:33 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.info is being set with open permissions: ugo+rw Sep 04 15:59:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:33 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.802280ab-3206-430b-97f5-3cfb416fea83" returned: 0 in 0.402s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.802280ab-3206-430b-97f5-3cfb416fea83 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:33 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.info Sep 04 15:59:33 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d00dc7c7-f92f-4e38-8d5a-df1829050c14 tempest-VolumesSnapshotListTestJSON-2123040737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d00dc7c7-f92f-4e38-8d5a-df1829050c14 tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:33 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d00dc7c7-f92f-4e38-8d5a-df1829050c14 tempest-VolumesSnapshotListTestJSON-2123040737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:59:33 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.802280ab-3206-430b-97f5-3cfb416fea83 Sep 04 15:59:33 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:33 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d00dc7c7-f92f-4e38-8d5a-df1829050c14 tempest-VolumesSnapshotListTestJSON-2123040737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:59:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d00dc7c7-f92f-4e38-8d5a-df1829050c14 tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d00dc7c7-f92f-4e38-8d5a-df1829050c14 tempest-VolumesSnapshotListTestJSON-2123040737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:33 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:59:33 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:34 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.info" returned: 0 in 0.284s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Acquiring lock "cinder-quobyte-3fafae48-c73a-4c96-8283-6280fc452ded" by "_copy_volume_from_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:34 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Lock "cinder-quobyte-3fafae48-c73a-4c96-8283-6280fc452ded" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] snapshot: fc22c583-57db-4a4d-9831-88c856d85c6a, volume: 3fafae48-c73a-4c96-8283-6280fc452ded, {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e.802280ab-3206-430b-97f5-3cfb416fea83" returned: 0 in 0.332s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:34 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b9ef35-9fcd-43b2-9244-ba213ec45637]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.fc22c583-57db-4a4d-9831-88c856d85c6a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d00dc7c7-f92f-4e38-8d5a-df1829050c14 tempest-VolumesSnapshotListTestJSON-2123040737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.326s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d00dc7c7-f92f-4e38-8d5a-df1829050c14 tempest-VolumesSnapshotListTestJSON-2123040737 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-quobyte-802280ab-3206-430b-97f5-3cfb416fea83" released by "_delete_snapshot" :: held 1.819s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:34 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-d00dc7c7-f92f-4e38-8d5a-df1829050c14 tempest-VolumesSnapshotListTestJSON-2123040737 None] Deleted volume successfully. Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-quobyte-e47c84bc-b858-47ab-a4da-034be203e46e" released by "delete_snapshot" :: held 1.850s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d00dc7c7-f92f-4e38-8d5a-df1829050c14 tempest-VolumesSnapshotListTestJSON-2123040737 None] Lock "cinder-b0091f9b-b4f6-4a53-94ae-0e4b4863b41c-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Created reservations ['dc1947a3-94fd-4781-ad8f-b52aeb8eacad', '277498cb-fb7a-4df2-9855-198d4396aba5', '4a7938d9-ba95-45ad-9859-938833ba0234', '8be2429a-ff4b-4247-8dfb-d3a06430330b'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:34 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.fc22c583-57db-4a4d-9831-88c856d85c6a Sep 04 15:59:34 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:34 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Delete snapshot completed successfully. Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-802280ab-3206-430b-97f5-3cfb416fea83-delete_snapshot" released by "delete_snapshot" :: held 2.030s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Snapshots deleted, issuing volume delete {{(pid=87490) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "cinder-quobyte-e47c84bc-b858-47ab-a4da-034be203e46e" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-quobyte-e47c84bc-b858-47ab-a4da-034be203e46e" acquired by "delete_volume" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e73da26-b26d-4bd7-973f-a82ea2856a02]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:34 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e Sep 04 15:59:34 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:34 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.fc22c583-57db-4a4d-9831-88c856d85c6a" returned: 0 in 0.436s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1b8d96d-37fe-4929-bdfe-14299b32462d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4e0323-145e-4935-a8c1-6d61bb0167e8]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:34 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d Sep 04 15:59:34 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:34 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e" returned: 0 in 0.417s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:35 devstack sudo[100034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e Sep 04 15:59:35 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:35 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d" returned: 0 in 0.426s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 15:59:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Creating direct copy from snapshot {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 15:59:35 devstack cinder-volume[87490]: DEBUG cinder.utils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Path /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3fafae48-c73a-4c96-8283-6280fc452ded not found in is_blk_device check {{(pid=87490) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 15:59:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3fafae48-c73a-4c96-8283-6280fc452ded {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:35 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3fafae48-c73a-4c96-8283-6280fc452ded Sep 04 15:59:35 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:35 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e47c84bc-b858-47ab-a4da-034be203e46e" returned: 0 in 0.283s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-quobyte-e47c84bc-b858-47ab-a4da-034be203e46e" released by "delete_volume" :: held 0.788s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:35 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Created reservations ['54d51261-c441-40d4-89e6-e417f4d7c027', 'e7bc5e74-6533-4c8c-a4c2-8d6962b5324f', '390a0b0d-3e10-45c5-bf52-ecc739f23dc3', '54035827-5751-4faa-965a-051a85b1bfb3'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:59:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:59:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:35 devstack sudo[100042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:59:35 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:35 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.314s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:35 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:35 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Deleted volume successfully. Sep 04 15:59:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ae7858ba-648e-4e8c-bf6b-2e66185a6db6 tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-e47c84bc-b858-47ab-a4da-034be203e46e-delete_volume" released by "delete_volume" :: held 3.428s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-529d057c-01a1-4090-a176-397ae4431c6e tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "cinder-c438f9c5-0724-41e7-bbb8-dfc27e47365e-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:36 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-529d057c-01a1-4090-a176-397ae4431c6e tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-c438f9c5-0724-41e7-bbb8-dfc27e47365e-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:36 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-529d057c-01a1-4090-a176-397ae4431c6e tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "cinder-quobyte-c438f9c5-0724-41e7-bbb8-dfc27e47365e" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:36 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-529d057c-01a1-4090-a176-397ae4431c6e tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-quobyte-c438f9c5-0724-41e7-bbb8-dfc27e47365e" acquired by "delete_volume" :: waited 0.031s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:36 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[007f4234-71a7-454f-abb1-7c1a7476d6fa]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-529d057c-01a1-4090-a176-397ae4431c6e tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c438f9c5-0724-41e7-bbb8-dfc27e47365e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:36 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c438f9c5-0724-41e7-bbb8-dfc27e47365e Sep 04 15:59:36 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:36 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-529d057c-01a1-4090-a176-397ae4431c6e tempest-VolumesDeleteCascade-1571857455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c438f9c5-0724-41e7-bbb8-dfc27e47365e" returned: 0 in 0.762s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-529d057c-01a1-4090-a176-397ae4431c6e tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c438f9c5-0724-41e7-bbb8-dfc27e47365e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:37 devstack sudo[100061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c438f9c5-0724-41e7-bbb8-dfc27e47365e Sep 04 15:59:37 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:37 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-529d057c-01a1-4090-a176-397ae4431c6e tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c438f9c5-0724-41e7-bbb8-dfc27e47365e" returned: 0 in 0.507s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:37 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-529d057c-01a1-4090-a176-397ae4431c6e tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-quobyte-c438f9c5-0724-41e7-bbb8-dfc27e47365e" released by "delete_volume" :: held 1.378s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:37 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-529d057c-01a1-4090-a176-397ae4431c6e tempest-VolumesDeleteCascade-1571857455 None] Created reservations ['725542a0-8fa4-4f67-807e-15d682a9458e', '3e84ec3c-fed0-4edd-905a-88947f5265aa', 'ae11e531-4984-482f-baa7-c43faec576b7', 'b59c0710-9dd5-4968-a1db-82be310203a1'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-529d057c-01a1-4090-a176-397ae4431c6e tempest-VolumesDeleteCascade-1571857455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-529d057c-01a1-4090-a176-397ae4431c6e tempest-VolumesDeleteCascade-1571857455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:37 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-529d057c-01a1-4090-a176-397ae4431c6e tempest-VolumesDeleteCascade-1571857455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:59:37 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-529d057c-01a1-4090-a176-397ae4431c6e tempest-VolumesDeleteCascade-1571857455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:59:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-529d057c-01a1-4090-a176-397ae4431c6e tempest-VolumesDeleteCascade-1571857455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-529d057c-01a1-4090-a176-397ae4431c6e tempest-VolumesDeleteCascade-1571857455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:37 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:59:37 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:59:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:59:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:59:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:38 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:59:38 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:38 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-529d057c-01a1-4090-a176-397ae4431c6e tempest-VolumesDeleteCascade-1571857455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.655s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:38 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-529d057c-01a1-4090-a176-397ae4431c6e tempest-VolumesDeleteCascade-1571857455 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:38 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-529d057c-01a1-4090-a176-397ae4431c6e tempest-VolumesDeleteCascade-1571857455 None] Deleted volume successfully. Sep 04 15:59:38 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-529d057c-01a1-4090-a176-397ae4431c6e tempest-VolumesDeleteCascade-1571857455 None] Lock "cinder-c438f9c5-0724-41e7-bbb8-dfc27e47365e-delete_volume" released by "delete_volume" :: held 2.573s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:38 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.671s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:38 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager._thread_info {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 15:59:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread count: 28 {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 15:59:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread info: [<_MainThread(MainThread, started 138899118923904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 15:59:40 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3fafae48-c73a-4c96-8283-6280fc452ded" returned: 0 in 5.009s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:40 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d, size 1024.00 MB, duration 5.01 sec, destination /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3fafae48-c73a-4c96-8283-6280fc452ded {{(pid=87490) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 15:59:40 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Converted 1024.00 MB image at 204.41 MB/s Sep 04 15:59:40 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3fafae48-c73a-4c96-8283-6280fc452ded is being set with open permissions: ugo+rw Sep 04 15:59:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3fafae48-c73a-4c96-8283-6280fc452ded {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:40 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3fafae48-c73a-4c96-8283-6280fc452ded Sep 04 15:59:40 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:40 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3fafae48-c73a-4c96-8283-6280fc452ded" returned: 0 in 0.286s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Lock "cinder-quobyte-3fafae48-c73a-4c96-8283-6280fc452ded" released by "_copy_volume_from_snapshot" :: held 6.255s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Acquiring lock "cinder-quobyte-fc22c583-57db-4a4d-9831-88c856d85c6a" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Lock "cinder-quobyte-fc22c583-57db-4a4d-9831-88c856d85c6a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:40 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Deleting offline snapshot fc22c583-57db-4a4d-9831-88c856d85c6a of volume d1b8d96d-37fe-4929-bdfe-14299b32462d {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 15:59:40 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] snapshot_file for this snap is: volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.fc22c583-57db-4a4d-9831-88c856d85c6a {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 15:59:40 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4ac45b-0454-4207-b2d5-c0e291cd4e24]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.fc22c583-57db-4a4d-9831-88c856d85c6a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:40 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.fc22c583-57db-4a4d-9831-88c856d85c6a Sep 04 15:59:40 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:40 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.fc22c583-57db-4a4d-9831-88c856d85c6a" returned: 0 in 0.435s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:40 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1b8d96d-37fe-4929-bdfe-14299b32462d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 15:59:41 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa2ef32-33d8-4ad1-b7ee-2a0aa9d55d4c]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:41 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d Sep 04 15:59:41 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:41 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d" returned: 0 in 0.583s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.fc22c583-57db-4a4d-9831-88c856d85c6a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:41 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.fc22c583-57db-4a4d-9831-88c856d85c6a Sep 04 15:59:41 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:41 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.fc22c583-57db-4a4d-9831-88c856d85c6a" returned: 0 in 0.365s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.fc22c583-57db-4a4d-9831-88c856d85c6a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:42 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.fc22c583-57db-4a4d-9831-88c856d85c6a Sep 04 15:59:42 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:42 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d.fc22c583-57db-4a4d-9831-88c856d85c6a" returned: 0 in 0.272s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:42 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Lock "cinder-quobyte-fc22c583-57db-4a4d-9831-88c856d85c6a" released by "_delete_snapshot" :: held 1.773s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.350s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c631608-03a4-4380-9749-667b20a0bc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fafae48-c73a-4c96-8283-6280fc452ded', 'volume_size': 1, 'source_volid': 'd1b8d96d-37fe-4929-bdfe-14299b32462d', 'source_volstatus': 'available'}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f2b12c-5c51-4696-878a-e030d4ea81d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:42 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Volume volume-3fafae48-c73a-4c96-8283-6280fc452ded (3fafae48-c73a-4c96-8283-6280fc452ded): created successfully Sep 04 15:59:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f2b12c-5c51-4696-878a-e030d4ea81d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Flow 'volume_create_manager' (70566168-5417-4186-8996-39cb9449c37c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:42 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-cd979ab4-7bca-44b5-a239-289d4a39dc96 tempest-VolumesGetTest-2047380607 None] Created volume successfully. Sep 04 15:59:44 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Flow 'volume_create_manager' (bbf00c81-1ca0-4fbd-83e5-22925cbdf131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22b7b7e-59f7-4820-ad9c-2bee7c798556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22b7b7e-59f7-4820-ad9c-2bee7c798556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1845347227',display_name='tempest-VolumesGetTest-Volume-1966588337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182d5236-e0ec-40fc-823c-f9ef1f2acf48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e958005d63114a308a1fe83ce485f5f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:44Z,use_quota=True,user_id='12336b3bfc7a4918bf5a62161901142d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0084db0c-8a1f-49fa-88e3-2af775834191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0084db0c-8a1f-49fa-88e3-2af775834191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcdc2031-fcee-41d8-aa15-28cec7fb66f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcdc2031-fcee-41d8-aa15-28cec7fb66f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '182d5236-e0ec-40fc-823c-f9ef1f2acf48', 'volume_name': 'volume-182d5236-e0ec-40fc-823c-f9ef1f2acf48', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ab6646-9188-4580-9cc2-222303ffd0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ab6646-9188-4580-9cc2-222303ffd0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7953866e-e1fc-448b-b443-d98d21f83b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:44 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Volume 182d5236-e0ec-40fc-823c-f9ef1f2acf48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-182d5236-e0ec-40fc-823c-f9ef1f2acf48', 'volume_size': 1} Sep 04 15:59:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1845347227',display_name='tempest-VolumesGetTest-Volume-1966588337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182d5236-e0ec-40fc-823c-f9ef1f2acf48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e958005d63114a308a1fe83ce485f5f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:44Z,use_quota=True,user_id='12336b3bfc7a4918bf5a62161901142d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:59:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Creating volume 182d5236-e0ec-40fc-823c-f9ef1f2acf48 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:59:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:59:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:59:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:59:44 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:59:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-182d5236-e0ec-40fc-823c-f9ef1f2acf48 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:44 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-182d5236-e0ec-40fc-823c-f9ef1f2acf48 1073741824 Sep 04 15:59:44 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:44 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-182d5236-e0ec-40fc-823c-f9ef1f2acf48 1073741824" returned: 0 in 0.459s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-182d5236-e0ec-40fc-823c-f9ef1f2acf48 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:44 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-182d5236-e0ec-40fc-823c-f9ef1f2acf48 Sep 04 15:59:44 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:44 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-182d5236-e0ec-40fc-823c-f9ef1f2acf48" returned: 0 in 0.278s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:59:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7953866e-e1fc-448b-b443-d98d21f83b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-182d5236-e0ec-40fc-823c-f9ef1f2acf48', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415305a2-68fd-4ecc-a45c-f90bdf0c29ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:45 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Volume volume-182d5236-e0ec-40fc-823c-f9ef1f2acf48 (182d5236-e0ec-40fc-823c-f9ef1f2acf48): created successfully Sep 04 15:59:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415305a2-68fd-4ecc-a45c-f90bdf0c29ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Flow 'volume_create_manager' (bbf00c81-1ca0-4fbd-83e5-22925cbdf131) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:45 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-3e7c31f0-e651-4726-a6c2-388e7a594dae tempest-VolumesGetTest-2047380607 None] Created volume successfully. Sep 04 15:59:46 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-92a480d3-2a9d-45df-9d69-1c00d1e75bca tempest-VolumesGetTest-2047380607 None] Acquiring lock "cinder-182d5236-e0ec-40fc-823c-f9ef1f2acf48-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:46 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-92a480d3-2a9d-45df-9d69-1c00d1e75bca tempest-VolumesGetTest-2047380607 None] Lock "cinder-182d5236-e0ec-40fc-823c-f9ef1f2acf48-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:46 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-92a480d3-2a9d-45df-9d69-1c00d1e75bca tempest-VolumesGetTest-2047380607 None] Acquiring lock "cinder-quobyte-182d5236-e0ec-40fc-823c-f9ef1f2acf48" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:46 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-92a480d3-2a9d-45df-9d69-1c00d1e75bca tempest-VolumesGetTest-2047380607 None] Lock "cinder-quobyte-182d5236-e0ec-40fc-823c-f9ef1f2acf48" acquired by "delete_volume" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:46 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1a13f2-62e7-4fe4-b7aa-b9dea688ae65]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-92a480d3-2a9d-45df-9d69-1c00d1e75bca tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-182d5236-e0ec-40fc-823c-f9ef1f2acf48 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:46 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-182d5236-e0ec-40fc-823c-f9ef1f2acf48 Sep 04 15:59:46 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:47 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-92a480d3-2a9d-45df-9d69-1c00d1e75bca tempest-VolumesGetTest-2047380607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-182d5236-e0ec-40fc-823c-f9ef1f2acf48" returned: 0 in 0.415s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-92a480d3-2a9d-45df-9d69-1c00d1e75bca tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-182d5236-e0ec-40fc-823c-f9ef1f2acf48 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:47 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-182d5236-e0ec-40fc-823c-f9ef1f2acf48 Sep 04 15:59:47 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:47 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-92a480d3-2a9d-45df-9d69-1c00d1e75bca tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-182d5236-e0ec-40fc-823c-f9ef1f2acf48" returned: 0 in 0.309s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-92a480d3-2a9d-45df-9d69-1c00d1e75bca tempest-VolumesGetTest-2047380607 None] Lock "cinder-quobyte-182d5236-e0ec-40fc-823c-f9ef1f2acf48" released by "delete_volume" :: held 0.779s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:47 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-92a480d3-2a9d-45df-9d69-1c00d1e75bca tempest-VolumesGetTest-2047380607 None] Created reservations ['884852e4-2051-42e3-9ae3-1fe3cf05b692', '6c7b90a3-99ef-4f05-942c-84382ea5e441', '32f5ae7f-5742-4b7a-a521-47fef42db216', '3c858677-5069-4688-898b-1d0606fc01f5'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-92a480d3-2a9d-45df-9d69-1c00d1e75bca tempest-VolumesGetTest-2047380607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-92a480d3-2a9d-45df-9d69-1c00d1e75bca tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:47 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-92a480d3-2a9d-45df-9d69-1c00d1e75bca tempest-VolumesGetTest-2047380607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:59:47 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-92a480d3-2a9d-45df-9d69-1c00d1e75bca tempest-VolumesGetTest-2047380607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:59:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-92a480d3-2a9d-45df-9d69-1c00d1e75bca tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-92a480d3-2a9d-45df-9d69-1c00d1e75bca tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:47 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:59:47 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-32a41ce2-5c73-4bc6-bad7-b2c84eab0e48 tempest-VolumesGetTest-2047380607 None] Acquiring lock "cinder-3fafae48-c73a-4c96-8283-6280fc452ded-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-32a41ce2-5c73-4bc6-bad7-b2c84eab0e48 tempest-VolumesGetTest-2047380607 None] Lock "cinder-3fafae48-c73a-4c96-8283-6280fc452ded-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:47 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-92a480d3-2a9d-45df-9d69-1c00d1e75bca tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.320s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:47 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-92a480d3-2a9d-45df-9d69-1c00d1e75bca tempest-VolumesGetTest-2047380607 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:47 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-92a480d3-2a9d-45df-9d69-1c00d1e75bca tempest-VolumesGetTest-2047380607 None] Deleted volume successfully. Sep 04 15:59:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-32a41ce2-5c73-4bc6-bad7-b2c84eab0e48 tempest-VolumesGetTest-2047380607 None] Acquiring lock "cinder-quobyte-3fafae48-c73a-4c96-8283-6280fc452ded" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-92a480d3-2a9d-45df-9d69-1c00d1e75bca tempest-VolumesGetTest-2047380607 None] Lock "cinder-182d5236-e0ec-40fc-823c-f9ef1f2acf48-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-32a41ce2-5c73-4bc6-bad7-b2c84eab0e48 tempest-VolumesGetTest-2047380607 None] Lock "cinder-quobyte-3fafae48-c73a-4c96-8283-6280fc452ded" acquired by "delete_volume" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:47 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc83e97-69f5-4435-8de6-ffc0c81d89cb]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-32a41ce2-5c73-4bc6-bad7-b2c84eab0e48 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3fafae48-c73a-4c96-8283-6280fc452ded {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:48 devstack sudo[100120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3fafae48-c73a-4c96-8283-6280fc452ded Sep 04 15:59:48 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:48 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-32a41ce2-5c73-4bc6-bad7-b2c84eab0e48 tempest-VolumesGetTest-2047380607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3fafae48-c73a-4c96-8283-6280fc452ded" returned: 0 in 0.381s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-32a41ce2-5c73-4bc6-bad7-b2c84eab0e48 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3fafae48-c73a-4c96-8283-6280fc452ded {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:48 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3fafae48-c73a-4c96-8283-6280fc452ded Sep 04 15:59:48 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:48 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-32a41ce2-5c73-4bc6-bad7-b2c84eab0e48 tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3fafae48-c73a-4c96-8283-6280fc452ded" returned: 0 in 0.284s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:48 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-32a41ce2-5c73-4bc6-bad7-b2c84eab0e48 tempest-VolumesGetTest-2047380607 None] Lock "cinder-quobyte-3fafae48-c73a-4c96-8283-6280fc452ded" released by "delete_volume" :: held 0.720s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:48 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-32a41ce2-5c73-4bc6-bad7-b2c84eab0e48 tempest-VolumesGetTest-2047380607 None] Created reservations ['f256e1c7-6104-44e8-ab61-8eed2bbe7f23', 'fa598027-897c-48c9-b1bf-eee7b92698fb', 'c2a6d16d-e6c3-4160-801d-dd4a6e108a46', '38944fe2-21c7-407e-9c9e-f766a4ae99c0'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-32a41ce2-5c73-4bc6-bad7-b2c84eab0e48 tempest-VolumesGetTest-2047380607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-32a41ce2-5c73-4bc6-bad7-b2c84eab0e48 tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-32a41ce2-5c73-4bc6-bad7-b2c84eab0e48 tempest-VolumesGetTest-2047380607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:59:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-32a41ce2-5c73-4bc6-bad7-b2c84eab0e48 tempest-VolumesGetTest-2047380607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:59:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-32a41ce2-5c73-4bc6-bad7-b2c84eab0e48 tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-32a41ce2-5c73-4bc6-bad7-b2c84eab0e48 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:48 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:59:48 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-215b0c84-8083-4b15-9cdc-666c9a161866 tempest-VolumesGetTest-2047380607 None] Acquiring lock "cinder-d1b8d96d-37fe-4929-bdfe-14299b32462d-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-215b0c84-8083-4b15-9cdc-666c9a161866 tempest-VolumesGetTest-2047380607 None] Lock "cinder-d1b8d96d-37fe-4929-bdfe-14299b32462d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-215b0c84-8083-4b15-9cdc-666c9a161866 tempest-VolumesGetTest-2047380607 None] Acquiring lock "cinder-quobyte-d1b8d96d-37fe-4929-bdfe-14299b32462d" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 15:59:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-215b0c84-8083-4b15-9cdc-666c9a161866 tempest-VolumesGetTest-2047380607 None] Lock "cinder-quobyte-d1b8d96d-37fe-4929-bdfe-14299b32462d" acquired by "delete_volume" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 15:59:49 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-32a41ce2-5c73-4bc6-bad7-b2c84eab0e48 tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.429s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:49 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-32a41ce2-5c73-4bc6-bad7-b2c84eab0e48 tempest-VolumesGetTest-2047380607 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:49 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-32a41ce2-5c73-4bc6-bad7-b2c84eab0e48 tempest-VolumesGetTest-2047380607 None] Deleted volume successfully. Sep 04 15:59:49 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c5a36f-d69b-489c-8d8a-fc870241448e]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-215b0c84-8083-4b15-9cdc-666c9a161866 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-32a41ce2-5c73-4bc6-bad7-b2c84eab0e48 tempest-VolumesGetTest-2047380607 None] Lock "cinder-3fafae48-c73a-4c96-8283-6280fc452ded-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:49 devstack sudo[100133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d Sep 04 15:59:49 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:49 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-215b0c84-8083-4b15-9cdc-666c9a161866 tempest-VolumesGetTest-2047380607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d" returned: 0 in 0.410s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-215b0c84-8083-4b15-9cdc-666c9a161866 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:49 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d Sep 04 15:59:49 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:49 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-215b0c84-8083-4b15-9cdc-666c9a161866 tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d1b8d96d-37fe-4929-bdfe-14299b32462d" returned: 0 in 0.325s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-215b0c84-8083-4b15-9cdc-666c9a161866 tempest-VolumesGetTest-2047380607 None] Lock "cinder-quobyte-d1b8d96d-37fe-4929-bdfe-14299b32462d" released by "delete_volume" :: held 0.817s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:50 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-215b0c84-8083-4b15-9cdc-666c9a161866 tempest-VolumesGetTest-2047380607 None] Created reservations ['44972fc1-a204-4829-b493-93406f746097', 'fc05d895-eb27-4974-a3eb-fc592051bc2c', '51ca3509-4c10-4efb-91fe-54df7ca398ed', '2aecd6c0-dd13-4e3b-a9e0-513dd8b62e78'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 15:59:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-215b0c84-8083-4b15-9cdc-666c9a161866 tempest-VolumesGetTest-2047380607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-215b0c84-8083-4b15-9cdc-666c9a161866 tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-215b0c84-8083-4b15-9cdc-666c9a161866 tempest-VolumesGetTest-2047380607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:59:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-215b0c84-8083-4b15-9cdc-666c9a161866 tempest-VolumesGetTest-2047380607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:59:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-215b0c84-8083-4b15-9cdc-666c9a161866 tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-215b0c84-8083-4b15-9cdc-666c9a161866 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:50 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 15:59:50 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:50 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-215b0c84-8083-4b15-9cdc-666c9a161866 tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.385s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:50 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-215b0c84-8083-4b15-9cdc-666c9a161866 tempest-VolumesGetTest-2047380607 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 15:59:50 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-215b0c84-8083-4b15-9cdc-666c9a161866 tempest-VolumesGetTest-2047380607 None] Deleted volume successfully. Sep 04 15:59:50 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-215b0c84-8083-4b15-9cdc-666c9a161866 tempest-VolumesGetTest-2047380607 None] Lock "cinder-d1b8d96d-37fe-4929-bdfe-14299b32462d-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 15:59:51 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Flow 'volume_create_manager' (5ceba3af-3b0f-42d7-acc1-2a890683f6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f423e7-d5e8-4934-87a6-0f3f801479b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f423e7-d5e8-4934-87a6-0f3f801479b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1025887325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c819bec-0343-4761-8dcb-ebf4369a6201,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e958005d63114a308a1fe83ce485f5f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:51Z,use_quota=True,user_id='12336b3bfc7a4918bf5a62161901142d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf91c97-f5f8-40f4-ac94-a64c9838b29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf91c97-f5f8-40f4-ac94-a64c9838b29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906e4032-5836-4e6f-9b09-3b09c3950835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:51 devstack cinder-volume[87490]: DEBUG cinder.image.glance [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Creating Keystone auth plugin from conf {{(pid=87490) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 15:59:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906e4032-5836-4e6f-9b09-3b09c3950835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9c819bec-0343-4761-8dcb-ebf4369a6201', 'volume_name': 'volume-9c819bec-0343-4761-8dcb-ebf4369a6201', 'volume_size': 1, 'image_id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f11b89ae18364ea089a6f8a208910da3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'created_at': datetime.datetime(2026, 9, 4, 13, 42, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 42, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5558c17-c499-44af-95fb-afb0cb03a012/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda97d42-6174-4045-960f-57d846f33685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda97d42-6174-4045-960f-57d846f33685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62747c50-f9c2-4f70-92bd-9d73e2fee5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:51 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Volume 9c819bec-0343-4761-8dcb-ebf4369a6201: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9c819bec-0343-4761-8dcb-ebf4369a6201', 'volume_size': 1, 'image_id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f11b89ae18364ea089a6f8a208910da3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'created_at': datetime.datetime(2026, 9, 4, 13, 42, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 42, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5558c17-c499-44af-95fb-afb0cb03a012/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 15:59:51 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Trying to clone 9c819bec-0343-4761-8dcb-ebf4369a6201 from image b5558c17-c499-44af-95fb-afb0cb03a012 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}]). {{(pid=87490) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 15:59:52 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_x79jgn81devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 15:59:52 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Image download 20.69 MB at 20.69 MB/s Sep 04 15:59:52 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2c328e-36ff-43c1-bb0c-4cfe5267536f]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_x79jgn81devstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:52 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_x79jgn81devstack@QuobyteHD Sep 04 15:59:52 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:52 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_x79jgn81devstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:52 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Temporary image b5558c17-c499-44af-95fb-afb0cb03a012 is fetched for user 12336b3bfc7a4918bf5a62161901142d. {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 15:59:52 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[2851b876-59ca-4bee-b4d6-b3a1e68e6e25]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_x79jgn81devstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:52 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_x79jgn81devstack@QuobyteHD Sep 04 15:59:52 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:53 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_x79jgn81devstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1025887325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c819bec-0343-4761-8dcb-ebf4369a6201,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e958005d63114a308a1fe83ce485f5f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T13:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T13:59:51Z,use_quota=True,user_id='12336b3bfc7a4918bf5a62161901142d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:59:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Creating volume 9c819bec-0343-4761-8dcb-ebf4369a6201 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:59:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:59:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:59:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:59:53 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:59:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9c819bec-0343-4761-8dcb-ebf4369a6201 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:53 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9c819bec-0343-4761-8dcb-ebf4369a6201 1073741824 Sep 04 15:59:53 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:53 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9c819bec-0343-4761-8dcb-ebf4369a6201 1073741824" returned: 0 in 0.483s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9c819bec-0343-4761-8dcb-ebf4369a6201 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:53 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9c819bec-0343-4761-8dcb-ebf4369a6201 Sep 04 15:59:53 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:53 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9c819bec-0343-4761-8dcb-ebf4369a6201" returned: 0 in 0.249s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 15:59:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:53 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Attempting download of b5558c17-c499-44af-95fb-afb0cb03a012 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}])) to volume 9c819bec-0343-4761-8dcb-ebf4369a6201. {{(pid=87490) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 15:59:53 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[23180be7-13b4-4197-8425-a80d003a677c]: (4, 'raw') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_hmialli1 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:54 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_hmialli1 Sep 04 15:59:54 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:54 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_hmialli1" returned: 0 in 0.345s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_hmialli1 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:54 devstack sudo[100170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_hmialli1 Sep 04 15:59:54 devstack sudo[100170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:54 devstack sudo[100170]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_hmialli1" returned: 1 in 0.374s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_hmialli1' failed. Not Retrying. {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 15:59:54 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f73dcdd-3069-4e9a-9099-718886abce2b]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 15:59:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_x79jgn81devstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:54 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_x79jgn81devstack@QuobyteHD Sep 04 15:59:54 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:55 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_x79jgn81devstack@QuobyteHD" returned: 0 in 0.416s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:55 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] b5558c17-c499-44af-95fb-afb0cb03a012 was qcow2, converting to qcow2 {{(pid=87490) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 15:59:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_x79jgn81devstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9c819bec-0343-4761-8dcb-ebf4369a6201 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:55 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_x79jgn81devstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9c819bec-0343-4761-8dcb-ebf4369a6201 Sep 04 15:59:55 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:57 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_x79jgn81devstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9c819bec-0343-4761-8dcb-ebf4369a6201" returned: 0 in 2.141s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:57 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_x79jgn81devstack@QuobyteHD, size 112.00 MB, duration 2.14 sec, destination /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9c819bec-0343-4761-8dcb-ebf4369a6201 {{(pid=87490) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 15:59:57 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Converted 112.00 MB image at 52.28 MB/s Sep 04 15:59:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9c819bec-0343-4761-8dcb-ebf4369a6201 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:57 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9c819bec-0343-4761-8dcb-ebf4369a6201 1G Sep 04 15:59:57 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 15:59:57 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Sep 04 15:59:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9c819bec-0343-4761-8dcb-ebf4369a6201 1G" returned: 0 in 0.429s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 15:59:57 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Downloaded image b5558c17-c499-44af-95fb-afb0cb03a012 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}])) to volume 9c819bec-0343-4761-8dcb-ebf4369a6201 successfully. {{(pid=87490) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 15:59:57 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Temporary image b5558c17-c499-44af-95fb-afb0cb03a012 for user 12336b3bfc7a4918bf5a62161901142d is deleted. {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 15:59:57 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Marking volume 9c819bec-0343-4761-8dcb-ebf4369a6201 as bootable. {{(pid=87490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 15:59:57 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Copying metadata from image b5558c17-c499-44af-95fb-afb0cb03a012 to 9c819bec-0343-4761-8dcb-ebf4369a6201. {{(pid=87490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 15:59:57 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Creating volume glance metadata for volume 9c819bec-0343-4761-8dcb-ebf4369a6201 backed by image b5558c17-c499-44af-95fb-afb0cb03a012 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87490) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 15:59:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62747c50-f9c2-4f70-92bd-9d73e2fee5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c819bec-0343-4761-8dcb-ebf4369a6201', 'volume_size': 1, 'image_id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f11b89ae18364ea089a6f8a208910da3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'created_at': datetime.datetime(2026, 9, 4, 13, 42, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 42, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5558c17-c499-44af-95fb-afb0cb03a012/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd1bfbe-d59c-46c1-846e-fa4a0caf8725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:57 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Volume volume-9c819bec-0343-4761-8dcb-ebf4369a6201 (9c819bec-0343-4761-8dcb-ebf4369a6201): created successfully Sep 04 15:59:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd1bfbe-d59c-46c1-846e-fa4a0caf8725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Flow 'volume_create_manager' (5ceba3af-3b0f-42d7-acc1-2a890683f6a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:57 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-ad91c2b4-7a0a-4238-996a-524211557008 tempest-VolumesGetTest-2047380607 None] Created volume successfully. Sep 04 15:59:59 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 15:59:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Flow 'volume_create_manager' (03ac99cf-e0a1-44d6-8a1a-02d96558f8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 15:59:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7dd1b7-aae7-4124-9a21-158e74fd35cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7dd1b7-aae7-4124-9a21-158e74fd35cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1352346925',display_name='tempest-VolumesGetTest-Volume-43124239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc24e08-51a8-417e-99fc-ada8c397501c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e958005d63114a308a1fe83ce485f5f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:00Z,use_quota=True,user_id='12336b3bfc7a4918bf5a62161901142d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9613058-5631-48e9-a27f-696c5d6f2915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9613058-5631-48e9-a27f-696c5d6f2915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18488bd0-a752-447f-bbe2-0ce3fe866364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18488bd0-a752-447f-bbe2-0ce3fe866364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bc24e08-51a8-417e-99fc-ada8c397501c', 'volume_name': 'volume-5bc24e08-51a8-417e-99fc-ada8c397501c', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (653bd6e6-c3d5-4310-ad0f-c9f26c8690b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (653bd6e6-c3d5-4310-ad0f-c9f26c8690b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 15:59:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b72516-88b9-48b6-a734-5167ca304e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 15:59:59 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Volume 5bc24e08-51a8-417e-99fc-ada8c397501c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bc24e08-51a8-417e-99fc-ada8c397501c', 'volume_size': 1} Sep 04 15:59:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:59 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T13:59:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1352346925',display_name='tempest-VolumesGetTest-Volume-43124239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc24e08-51a8-417e-99fc-ada8c397501c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e958005d63114a308a1fe83ce485f5f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:00Z,use_quota=True,user_id='12336b3bfc7a4918bf5a62161901142d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 15:59:59 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Creating volume 5bc24e08-51a8-417e-99fc-ada8c397501c {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 15:59:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 15:59:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 15:59:59 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 15:59:59 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 15:59:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 15:59:59 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 15:59:59 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 15:59:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5bc24e08-51a8-417e-99fc-ada8c397501c 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 15:59:59 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5bc24e08-51a8-417e-99fc-ada8c397501c 1073741824 Sep 04 15:59:59 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:00 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5bc24e08-51a8-417e-99fc-ada8c397501c 1073741824" returned: 0 in 0.530s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5bc24e08-51a8-417e-99fc-ada8c397501c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:00 devstack sudo[100205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5bc24e08-51a8-417e-99fc-ada8c397501c Sep 04 16:00:00 devstack sudo[100205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:00 devstack sudo[100205]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5bc24e08-51a8-417e-99fc-ada8c397501c" returned: 0 in 0.291s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:00 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:00:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b72516-88b9-48b6-a734-5167ca304e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bc24e08-51a8-417e-99fc-ada8c397501c', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1454ea2d-2589-41f9-a036-df903e7f18e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:00 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Volume volume-5bc24e08-51a8-417e-99fc-ada8c397501c (5bc24e08-51a8-417e-99fc-ada8c397501c): created successfully Sep 04 16:00:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1454ea2d-2589-41f9-a036-df903e7f18e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Flow 'volume_create_manager' (03ac99cf-e0a1-44d6-8a1a-02d96558f8bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:00 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-cd058b3e-e90d-44a1-bd8a-80ea5269fbcf tempest-VolumesGetTest-2047380607 None] Created volume successfully. Sep 04 16:00:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-fab3806f-4178-46a7-b94f-1671f48cf3c9 tempest-VolumesGetTest-2047380607 None] Acquiring lock "cinder-5bc24e08-51a8-417e-99fc-ada8c397501c-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-fab3806f-4178-46a7-b94f-1671f48cf3c9 tempest-VolumesGetTest-2047380607 None] Lock "cinder-5bc24e08-51a8-417e-99fc-ada8c397501c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:02 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-fab3806f-4178-46a7-b94f-1671f48cf3c9 tempest-VolumesGetTest-2047380607 None] Acquiring lock "cinder-quobyte-5bc24e08-51a8-417e-99fc-ada8c397501c" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:02 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-fab3806f-4178-46a7-b94f-1671f48cf3c9 tempest-VolumesGetTest-2047380607 None] Lock "cinder-quobyte-5bc24e08-51a8-417e-99fc-ada8c397501c" acquired by "delete_volume" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:02 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac30501-fafe-4488-9f32-235bd74c0954]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-fab3806f-4178-46a7-b94f-1671f48cf3c9 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5bc24e08-51a8-417e-99fc-ada8c397501c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:02 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5bc24e08-51a8-417e-99fc-ada8c397501c Sep 04 16:00:02 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:02 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-fab3806f-4178-46a7-b94f-1671f48cf3c9 tempest-VolumesGetTest-2047380607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5bc24e08-51a8-417e-99fc-ada8c397501c" returned: 0 in 0.427s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-fab3806f-4178-46a7-b94f-1671f48cf3c9 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5bc24e08-51a8-417e-99fc-ada8c397501c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:02 devstack sudo[100213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5bc24e08-51a8-417e-99fc-ada8c397501c Sep 04 16:00:02 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:02 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-fab3806f-4178-46a7-b94f-1671f48cf3c9 tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5bc24e08-51a8-417e-99fc-ada8c397501c" returned: 0 in 0.315s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:02 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-fab3806f-4178-46a7-b94f-1671f48cf3c9 tempest-VolumesGetTest-2047380607 None] Lock "cinder-quobyte-5bc24e08-51a8-417e-99fc-ada8c397501c" released by "delete_volume" :: held 0.797s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:02 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-fab3806f-4178-46a7-b94f-1671f48cf3c9 tempest-VolumesGetTest-2047380607 None] Created reservations ['cf8d288d-c4d4-4b17-b9dc-97c095854350', '58f28dbc-04f2-46e6-9059-d979152d34c5', '4209920d-9603-489d-99a7-b1a4da1a0a0d', 'ce1b2827-b3c3-4910-87ed-112c9c32524b'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:00:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-fab3806f-4178-46a7-b94f-1671f48cf3c9 tempest-VolumesGetTest-2047380607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-fab3806f-4178-46a7-b94f-1671f48cf3c9 tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-fab3806f-4178-46a7-b94f-1671f48cf3c9 tempest-VolumesGetTest-2047380607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:00:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-fab3806f-4178-46a7-b94f-1671f48cf3c9 tempest-VolumesGetTest-2047380607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:00:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-fab3806f-4178-46a7-b94f-1671f48cf3c9 tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-fab3806f-4178-46a7-b94f-1671f48cf3c9 tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:03 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:00:03 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-9bc51cb7-c942-4247-b89f-24dd20f5fc9d tempest-VolumesGetTest-2047380607 None] Acquiring lock "cinder-9c819bec-0343-4761-8dcb-ebf4369a6201-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-9bc51cb7-c942-4247-b89f-24dd20f5fc9d tempest-VolumesGetTest-2047380607 None] Lock "cinder-9c819bec-0343-4761-8dcb-ebf4369a6201-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-9bc51cb7-c942-4247-b89f-24dd20f5fc9d tempest-VolumesGetTest-2047380607 None] Acquiring lock "cinder-quobyte-9c819bec-0343-4761-8dcb-ebf4369a6201" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-9bc51cb7-c942-4247-b89f-24dd20f5fc9d tempest-VolumesGetTest-2047380607 None] Lock "cinder-quobyte-9c819bec-0343-4761-8dcb-ebf4369a6201" acquired by "delete_volume" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:03 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2ace68-6254-4572-aa98-13241f2d2341]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9bc51cb7-c942-4247-b89f-24dd20f5fc9d tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9c819bec-0343-4761-8dcb-ebf4369a6201 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:03 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-fab3806f-4178-46a7-b94f-1671f48cf3c9 tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.360s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:03 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-fab3806f-4178-46a7-b94f-1671f48cf3c9 tempest-VolumesGetTest-2047380607 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:00:03 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-fab3806f-4178-46a7-b94f-1671f48cf3c9 tempest-VolumesGetTest-2047380607 None] Deleted volume successfully. Sep 04 16:00:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-fab3806f-4178-46a7-b94f-1671f48cf3c9 tempest-VolumesGetTest-2047380607 None] Lock "cinder-5bc24e08-51a8-417e-99fc-ada8c397501c-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:03 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9c819bec-0343-4761-8dcb-ebf4369a6201 Sep 04 16:00:03 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:03 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9bc51cb7-c942-4247-b89f-24dd20f5fc9d tempest-VolumesGetTest-2047380607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9c819bec-0343-4761-8dcb-ebf4369a6201" returned: 0 in 0.444s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9bc51cb7-c942-4247-b89f-24dd20f5fc9d tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9c819bec-0343-4761-8dcb-ebf4369a6201 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:03 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9c819bec-0343-4761-8dcb-ebf4369a6201 Sep 04 16:00:03 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:04 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9bc51cb7-c942-4247-b89f-24dd20f5fc9d tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9c819bec-0343-4761-8dcb-ebf4369a6201" returned: 0 in 0.309s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:04 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-9bc51cb7-c942-4247-b89f-24dd20f5fc9d tempest-VolumesGetTest-2047380607 None] Lock "cinder-quobyte-9c819bec-0343-4761-8dcb-ebf4369a6201" released by "delete_volume" :: held 0.810s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:04 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-9bc51cb7-c942-4247-b89f-24dd20f5fc9d tempest-VolumesGetTest-2047380607 None] Created reservations ['a51e6b99-c9f8-4109-9a3a-02dc8bedc2a3', '545c2b94-63c1-4f51-a0e6-70022b341c90', 'c7a5884d-b0e8-452c-a149-60c3440a12ab', '8d66defc-8e74-4b44-b080-757ebe4bfc10'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:00:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9bc51cb7-c942-4247-b89f-24dd20f5fc9d tempest-VolumesGetTest-2047380607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9bc51cb7-c942-4247-b89f-24dd20f5fc9d tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:04 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9bc51cb7-c942-4247-b89f-24dd20f5fc9d tempest-VolumesGetTest-2047380607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:00:04 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9bc51cb7-c942-4247-b89f-24dd20f5fc9d tempest-VolumesGetTest-2047380607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:00:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9bc51cb7-c942-4247-b89f-24dd20f5fc9d tempest-VolumesGetTest-2047380607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9bc51cb7-c942-4247-b89f-24dd20f5fc9d tempest-VolumesGetTest-2047380607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:04 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:00:04 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:04 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9bc51cb7-c942-4247-b89f-24dd20f5fc9d tempest-VolumesGetTest-2047380607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.348s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:04 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-9bc51cb7-c942-4247-b89f-24dd20f5fc9d tempest-VolumesGetTest-2047380607 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:00:04 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-9bc51cb7-c942-4247-b89f-24dd20f5fc9d tempest-VolumesGetTest-2047380607 None] Deleted volume successfully. Sep 04 16:00:04 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-9bc51cb7-c942-4247-b89f-24dd20f5fc9d tempest-VolumesGetTest-2047380607 None] Lock "cinder-9c819bec-0343-4761-8dcb-ebf4369a6201-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:09 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:00:09 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Flow 'volume_create_manager' (cdaae33e-ab4d-4155-9dbf-09609bf47782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:09 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba69ab0-b35f-4f5f-80fa-970080248743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:09 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba69ab0-b35f-4f5f-80fa-970080248743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1214031481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a78e78c4e147483dbcae55ef384be4a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:09Z,use_quota=True,user_id='2e71526f0cee4c6993719d5388dfc159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:09 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90958ea0-bd18-4ca4-b7d1-b29cfc2e96bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:09 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90958ea0-bd18-4ca4-b7d1-b29cfc2e96bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:09 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d095eb01-490a-446c-95a3-9dfd6d598e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:09 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d095eb01-490a-446c-95a3-9dfd6d598e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2', 'volume_name': 'volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2', 'volume_size': 2}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:09 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3d114f3-3b4a-4b3d-bbf3-5eb0a4d64f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:09 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3d114f3-3b4a-4b3d-bbf3-5eb0a4d64f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:09 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69279269-ced3-4e87-80fe-b2984c940ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:09 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Volume 04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2', 'volume_size': 2} Sep 04 16:00:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:09 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1214031481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a78e78c4e147483dbcae55ef384be4a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:09Z,use_quota=True,user_id='2e71526f0cee4c6993719d5388dfc159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:00:09 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Creating volume 04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:00:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:09 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:00:09 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:00:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:09 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:00:09 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:00:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2 2147483648 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:09 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2 2147483648 Sep 04 16:00:09 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:10 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2 2147483648" returned: 0 in 0.776s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:10 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:00:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Flow 'volume_create_manager' (ff58c6ca-6e3e-403d-a40a-d0070918ba01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f319eb87-cf51-4769-b457-84ca1354b10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f319eb87-cf51-4769-b457-84ca1354b10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-326692794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7905871-ed5e-4b14-aa67-5b87b622217d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7348b39f389f432a8b9cf58e0e5b4043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:10Z,use_quota=True,user_id='fe0bcefa451b4d8bb5f616278806258d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:10 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2 Sep 04 16:00:10 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786cd908-c069-4424-a65f-d5d45d14e4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786cd908-c069-4424-a65f-d5d45d14e4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e01caf-061a-401e-896f-a6cdcc19ae5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:10 devstack cinder-volume[87490]: DEBUG cinder.image.glance [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Creating Keystone auth plugin from conf {{(pid=87490) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 16:00:10 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2" returned: 0 in 0.338s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:00:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e01caf-061a-401e-896f-a6cdcc19ae5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e7905871-ed5e-4b14-aa67-5b87b622217d', 'volume_name': 'volume-e7905871-ed5e-4b14-aa67-5b87b622217d', 'volume_size': 1, 'image_id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f11b89ae18364ea089a6f8a208910da3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'created_at': datetime.datetime(2026, 9, 4, 13, 42, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 42, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5558c17-c499-44af-95fb-afb0cb03a012/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64080e51-4600-46e7-8124-36801d10d41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64080e51-4600-46e7-8124-36801d10d41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b7ffc6-5518-489f-aa06-4dcc44227e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:10 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Volume e7905871-ed5e-4b14-aa67-5b87b622217d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e7905871-ed5e-4b14-aa67-5b87b622217d', 'volume_size': 1, 'image_id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f11b89ae18364ea089a6f8a208910da3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'created_at': datetime.datetime(2026, 9, 4, 13, 42, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 42, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5558c17-c499-44af-95fb-afb0cb03a012/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 16:00:10 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Trying to clone e7905871-ed5e-4b14-aa67-5b87b622217d from image b5558c17-c499-44af-95fb-afb0cb03a012 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}]). {{(pid=87490) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 16:00:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69279269-ced3-4e87-80fe-b2984c940ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2', 'volume_size': 2}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f968a5d-9bc6-45b9-b970-a549945550b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:10 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Volume volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2 (04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2): created successfully Sep 04 16:00:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f968a5d-9bc6-45b9-b970-a549945550b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Flow 'volume_create_manager' (cdaae33e-ab4d-4155-9dbf-09609bf47782) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:11 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-79d4fae3-c062-416c-a025-45489b43f77a tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Created volume successfully. Sep 04 16:00:11 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_68lwk1p1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 16:00:11 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Image download 20.69 MB at 20.69 MB/s Sep 04 16:00:11 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[a196a308-eb4b-4f6c-a306-e5ce9a1e7dea]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_68lwk1p1devstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:11 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_68lwk1p1devstack@QuobyteHD Sep 04 16:00:11 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c7da5732-1bae-4555-8426-e3e246ed59d0 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c7da5732-1bae-4555-8426-e3e246ed59d0 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:11 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-c7da5732-1bae-4555-8426-e3e246ed59d0 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Creating offline snapshot 452e50b6-44f0-4a58-aa8b-98992a387c2e of volume 04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2 {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:00:11 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_68lwk1p1devstack@QuobyteHD" returned: 0 in 0.484s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:11 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Temporary image b5558c17-c499-44af-95fb-afb0cb03a012 is fetched for user fe0bcefa451b4d8bb5f616278806258d. {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 16:00:11 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cb4dc5-0b0e-4f32-904e-21d9ca2be0f6]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7da5732-1bae-4555-8426-e3e246ed59d0 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:12 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[21852437-518d-4fbc-8d71-351784c422a4]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_68lwk1p1devstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:12 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2 Sep 04 16:00:12 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:12 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_68lwk1p1devstack@QuobyteHD Sep 04 16:00:12 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:12 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7da5732-1bae-4555-8426-e3e246ed59d0 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2" returned: 0 in 0.401s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7da5732-1bae-4555-8426-e3e246ed59d0 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2.452e50b6-44f0-4a58-aa8b-98992a387c2e 2G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:12 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2.452e50b6-44f0-4a58-aa8b-98992a387c2e 2G Sep 04 16:00:12 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:12 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_68lwk1p1devstack@QuobyteHD" returned: 0 in 0.347s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:12 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7da5732-1bae-4555-8426-e3e246ed59d0 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2.452e50b6-44f0-4a58-aa8b-98992a387c2e 2G" returned: 0 in 0.417s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7da5732-1bae-4555-8426-e3e246ed59d0 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2.452e50b6-44f0-4a58-aa8b-98992a387c2e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:12 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2.452e50b6-44f0-4a58-aa8b-98992a387c2e Sep 04 16:00:12 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:13 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7da5732-1bae-4555-8426-e3e246ed59d0 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2.452e50b6-44f0-4a58-aa8b-98992a387c2e" returned: 0 in 0.297s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:13 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-c7da5732-1bae-4555-8426-e3e246ed59d0 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2.452e50b6-44f0-4a58-aa8b-98992a387c2e is being set with open permissions: ugo+rw Sep 04 16:00:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7da5732-1bae-4555-8426-e3e246ed59d0 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2.452e50b6-44f0-4a58-aa8b-98992a387c2e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:13 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2.452e50b6-44f0-4a58-aa8b-98992a387c2e Sep 04 16:00:13 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:13 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7da5732-1bae-4555-8426-e3e246ed59d0 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2.452e50b6-44f0-4a58-aa8b-98992a387c2e" returned: 0 in 0.237s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7da5732-1bae-4555-8426-e3e246ed59d0 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:13 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2.info Sep 04 16:00:13 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:13 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7da5732-1bae-4555-8426-e3e246ed59d0 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2.info" returned: 0 in 0.255s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:13 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-c7da5732-1bae-4555-8426-e3e246ed59d0 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2.info is being set with open permissions: ugo+rw Sep 04 16:00:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7da5732-1bae-4555-8426-e3e246ed59d0 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:13 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2.info Sep 04 16:00:13 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:13 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7da5732-1bae-4555-8426-e3e246ed59d0 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2.info" returned: 0 in 0.259s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c7da5732-1bae-4555-8426-e3e246ed59d0 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.980s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.472s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-326692794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7905871-ed5e-4b14-aa67-5b87b622217d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7348b39f389f432a8b9cf58e0e5b4043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:10Z,use_quota=True,user_id='fe0bcefa451b4d8bb5f616278806258d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:00:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Creating volume e7905871-ed5e-4b14-aa67-5b87b622217d {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:00:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:00:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:00:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:00:13 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:00:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e7905871-ed5e-4b14-aa67-5b87b622217d 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:13 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e7905871-ed5e-4b14-aa67-5b87b622217d 1073741824 Sep 04 16:00:13 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:13 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-c7da5732-1bae-4555-8426-e3e246ed59d0 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Create snapshot completed successfully Sep 04 16:00:14 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e7905871-ed5e-4b14-aa67-5b87b622217d 1073741824" returned: 0 in 0.480s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e7905871-ed5e-4b14-aa67-5b87b622217d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:14 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e7905871-ed5e-4b14-aa67-5b87b622217d Sep 04 16:00:14 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Flow 'volume_create_manager' (fcc91620-8797-424a-b2d8-0f6959ec6db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (279326fb-9d90-4b63-af43-dec13f809a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (279326fb-9d90-4b63-af43-dec13f809a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1572999077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc73a763-601b-4b0a-9f91-3b8f938bcf92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd72477c59e6474fb8eb4a38c8be76b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:14Z,use_quota=True,user_id='057e355e5ff14d78a0b9658cd3ed9eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a344b-4d76-46ae-af6f-d1128695c6ca),volume_type_id=7e3a344b-4d76-46ae-af6f-d1128695c6ca)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d717d4ef-1a56-45f9-af5a-447e126b6f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d717d4ef-1a56-45f9-af5a-447e126b6f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ee6a16-6b10-4ac0-9347-c99bb5065a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ee6a16-6b10-4ac0-9347-c99bb5065a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc73a763-601b-4b0a-9f91-3b8f938bcf92', 'volume_name': 'volume-cc73a763-601b-4b0a-9f91-3b8f938bcf92', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7984499e-e89c-4dc8-9261-86e287025b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7984499e-e89c-4dc8-9261-86e287025b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d07797e2-5d58-4350-8033-6e3f0475dfbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:14 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Volume cc73a763-601b-4b0a-9f91-3b8f938bcf92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc73a763-601b-4b0a-9f91-3b8f938bcf92', 'volume_size': 1} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:14 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e7905871-ed5e-4b14-aa67-5b87b622217d" returned: 0 in 0.267s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.138s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1572999077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc73a763-601b-4b0a-9f91-3b8f938bcf92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd72477c59e6474fb8eb4a38c8be76b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:14Z,use_quota=True,user_id='057e355e5ff14d78a0b9658cd3ed9eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a344b-4d76-46ae-af6f-d1128695c6ca),volume_type_id=7e3a344b-4d76-46ae-af6f-d1128695c6ca)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Creating volume cc73a763-601b-4b0a-9f91-3b8f938bcf92 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:00:14 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cc73a763-601b-4b0a-9f91-3b8f938bcf92 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:14 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cc73a763-601b-4b0a-9f91-3b8f938bcf92 1073741824 Sep 04 16:00:14 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Attempting download of b5558c17-c499-44af-95fb-afb0cb03a012 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}])) to volume e7905871-ed5e-4b14-aa67-5b87b622217d. {{(pid=87490) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e30b516-86ed-4372-935c-981096f1a261]: (4, 'raw') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_2o3gwdta {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Flow 'volume_create_manager' (926472e0-591f-419b-8959-5a01735f9618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a3c9a8-6c41-488e-9086-c010b4d4b640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a3c9a8-6c41-488e-9086-c010b4d4b640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1582644688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f911dd81-bf8c-4124-902c-c51a56d7db69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd72477c59e6474fb8eb4a38c8be76b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:15Z,use_quota=True,user_id='057e355e5ff14d78a0b9658cd3ed9eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c5c3ad5-702d-48a8-9836-f165864eee1d),volume_type_id=5c5c3ad5-702d-48a8-9836-f165864eee1d)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a30dc5f6-b6d1-45b4-bdb9-6c211dc58a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a30dc5f6-b6d1-45b4-bdb9-6c211dc58a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c55e072-931c-468d-a2ce-3e162d553665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:14 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_2o3gwdta Sep 04 16:00:14 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c55e072-931c-468d-a2ce-3e162d553665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f911dd81-bf8c-4124-902c-c51a56d7db69', 'volume_name': 'volume-f911dd81-bf8c-4124-902c-c51a56d7db69', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8280f517-63ba-4ed4-9f51-61c9f2a575c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8280f517-63ba-4ed4-9f51-61c9f2a575c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48c5efac-2997-4866-8039-ca6ead0505ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:15 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Volume f911dd81-bf8c-4124-902c-c51a56d7db69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f911dd81-bf8c-4124-902c-c51a56d7db69', 'volume_size': 1} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4d4b3d1d-061f-4f7e-aa3c-094e8e89d972 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Acquiring lock "cinder-452e50b6-44f0-4a58-aa8b-98992a387c2e-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4d4b3d1d-061f-4f7e-aa3c-094e8e89d972 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Lock "cinder-452e50b6-44f0-4a58-aa8b-98992a387c2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4d4b3d1d-061f-4f7e-aa3c-094e8e89d972 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Acquiring lock "cinder-quobyte-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4d4b3d1d-061f-4f7e-aa3c-094e8e89d972 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Lock "cinder-quobyte-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4d4b3d1d-061f-4f7e-aa3c-094e8e89d972 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Acquiring lock "cinder-quobyte-452e50b6-44f0-4a58-aa8b-98992a387c2e" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4d4b3d1d-061f-4f7e-aa3c-094e8e89d972 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Lock "cinder-quobyte-452e50b6-44f0-4a58-aa8b-98992a387c2e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-4d4b3d1d-061f-4f7e-aa3c-094e8e89d972 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Deleting offline snapshot 452e50b6-44f0-4a58-aa8b-98992a387c2e of volume 04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:00:15 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-4d4b3d1d-061f-4f7e-aa3c-094e8e89d972 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] snapshot_file for this snap is: volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2.452e50b6-44f0-4a58-aa8b-98992a387c2e {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_2o3gwdta" returned: 0 in 0.440s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_2o3gwdta {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:15 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d05f6e-8dc7-4d51-9a14-02f055de4925]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4d4b3d1d-061f-4f7e-aa3c-094e8e89d972 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2.452e50b6-44f0-4a58-aa8b-98992a387c2e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cc73a763-601b-4b0a-9f91-3b8f938bcf92 1073741824" returned: 0 in 0.576s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cc73a763-601b-4b0a-9f91-3b8f938bcf92 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:15 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cc73a763-601b-4b0a-9f91-3b8f938bcf92 Sep 04 16:00:15 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:15 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2.452e50b6-44f0-4a58-aa8b-98992a387c2e Sep 04 16:00:15 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:15 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_2o3gwdta Sep 04 16:00:15 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:00:15 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Flow 'volume_create_manager' (84ca9b81-17c0-4ea0-87d8-22aec004f513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f897eb4-2cc6-446a-a256-cb99231b2301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cc73a763-601b-4b0a-9f91-3b8f938bcf92" returned: 0 in 0.297s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.626s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1582644688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f911dd81-bf8c-4124-902c-c51a56d7db69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd72477c59e6474fb8eb4a38c8be76b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:15Z,use_quota=True,user_id='057e355e5ff14d78a0b9658cd3ed9eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c5c3ad5-702d-48a8-9836-f165864eee1d),volume_type_id=5c5c3ad5-702d-48a8-9836-f165864eee1d)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Creating volume f911dd81-bf8c-4124-902c-c51a56d7db69 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:00:15 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f911dd81-bf8c-4124-902c-c51a56d7db69 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:15 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f911dd81-bf8c-4124-902c-c51a56d7db69 1073741824 Sep 04 16:00:15 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f897eb4-2cc6-446a-a256-cb99231b2301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-614788466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8140622d-98b7-4557-bf92-a30756c9a8e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd72477c59e6474fb8eb4a38c8be76b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:16Z,use_quota=True,user_id='057e355e5ff14d78a0b9658cd3ed9eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b813fde-6333-4a72-8276-1b2a48945377),volume_type_id=9b813fde-6333-4a72-8276-1b2a48945377)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb4f043-ac70-4bfb-9c4d-78ecd427b6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb4f043-ac70-4bfb-9c4d-78ecd427b6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:15 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15336e8e-1741-4dfe-882a-f4b81dec2fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.image.glance [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Creating Keystone auth plugin from conf {{(pid=87490) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_2o3gwdta" returned: 1 in 0.458s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5558c17-c499-44af-95fb-afb0cb03a012_2o3gwdta' failed. Not Retrying. {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d07797e2-5d58-4350-8033-6e3f0475dfbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc73a763-601b-4b0a-9f91-3b8f938bcf92', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a1418e6-58f0-411b-8435-f7002e237db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0bd716-4018-48fb-a372-f2d346ea2a7e]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:15 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_68lwk1p1devstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4d4b3d1d-061f-4f7e-aa3c-094e8e89d972 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2.452e50b6-44f0-4a58-aa8b-98992a387c2e" returned: 0 in 0.476s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-4d4b3d1d-061f-4f7e-aa3c-094e8e89d972 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:00:15 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Volume volume-cc73a763-601b-4b0a-9f91-3b8f938bcf92 (cc73a763-601b-4b0a-9f91-3b8f938bcf92): created successfully Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a1418e6-58f0-411b-8435-f7002e237db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Flow 'volume_create_manager' (fcc91620-8797-424a-b2d8-0f6959ec6db4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03d3309-fe4d-402f-93e4-d83bb382e758]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4d4b3d1d-061f-4f7e-aa3c-094e8e89d972 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:15 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-b5bf1102-c83f-48b0-bff1-43c72ebf1863 tempest-TestInstancesWithCinderVolumes-2052085588 None] Created volume successfully. Sep 04 16:00:15 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_68lwk1p1devstack@QuobyteHD Sep 04 16:00:15 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:15 devstack sudo[100313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2 Sep 04 16:00:15 devstack sudo[100313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15336e8e-1741-4dfe-882a-f4b81dec2fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8140622d-98b7-4557-bf92-a30756c9a8e9', 'volume_name': 'volume-8140622d-98b7-4557-bf92-a30756c9a8e9', 'volume_size': 1, 'image_id': '907ca86f-6a52-4671-a135-80b48d6432d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/907ca86f-6a52-4671-a135-80b48d6432d5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--528246234', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dd72477c59e6474fb8eb4a38c8be76b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '907ca86f-6a52-4671-a135-80b48d6432d5', 'created_at': datetime.datetime(2026, 9, 4, 14, 0, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 0, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/907ca86f-6a52-4671-a135-80b48d6432d5/file', 'properties': {}}, 'image_service': }' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7217c59-9d04-4842-bdfd-f92d8362bd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7217c59-9d04-4842-bdfd-f92d8362bd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (545c7bf1-2dae-4e2b-b3f5-3840a4ab495a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:16 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Volume 8140622d-98b7-4557-bf92-a30756c9a8e9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8140622d-98b7-4557-bf92-a30756c9a8e9', 'volume_size': 1, 'image_id': '907ca86f-6a52-4671-a135-80b48d6432d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/907ca86f-6a52-4671-a135-80b48d6432d5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--528246234', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dd72477c59e6474fb8eb4a38c8be76b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '907ca86f-6a52-4671-a135-80b48d6432d5', 'created_at': datetime.datetime(2026, 9, 4, 14, 0, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 0, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/907ca86f-6a52-4671-a135-80b48d6432d5/file', 'properties': {}}, 'image_service': } Sep 04 16:00:16 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Trying to clone 8140622d-98b7-4557-bf92-a30756c9a8e9 from image 907ca86f-6a52-4671-a135-80b48d6432d5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/907ca86f-6a52-4671-a135-80b48d6432d5', 'metadata': {}}]). {{(pid=87490) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 16:00:16 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_68lwk1p1devstack@QuobyteHD" returned: 0 in 0.406s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:16 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] b5558c17-c499-44af-95fb-afb0cb03a012 was qcow2, converting to qcow2 {{(pid=87490) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 16:00:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_68lwk1p1devstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e7905871-ed5e-4b14-aa67-5b87b622217d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:16 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:16 devstack sudo[100323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_68lwk1p1devstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e7905871-ed5e-4b14-aa67-5b87b622217d Sep 04 16:00:16 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f911dd81-bf8c-4124-902c-c51a56d7db69 1073741824" returned: 0 in 0.529s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f911dd81-bf8c-4124-902c-c51a56d7db69 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:16 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f911dd81-bf8c-4124-902c-c51a56d7db69 Sep 04 16:00:16 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:16 devstack sudo[100313]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4d4b3d1d-061f-4f7e-aa3c-094e8e89d972 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2" returned: 0 in 0.464s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4d4b3d1d-061f-4f7e-aa3c-094e8e89d972 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2.452e50b6-44f0-4a58-aa8b-98992a387c2e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:16 devstack sudo[100331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2.452e50b6-44f0-4a58-aa8b-98992a387c2e Sep 04 16:00:16 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:16 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f911dd81-bf8c-4124-902c-c51a56d7db69" returned: 0 in 0.292s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:00:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48c5efac-2997-4866-8039-ca6ead0505ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f911dd81-bf8c-4124-902c-c51a56d7db69', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84674326-1d4f-44ba-bdd8-14dc747bf5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:16 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Volume volume-f911dd81-bf8c-4124-902c-c51a56d7db69 (f911dd81-bf8c-4124-902c-c51a56d7db69): created successfully Sep 04 16:00:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84674326-1d4f-44ba-bdd8-14dc747bf5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Flow 'volume_create_manager' (926472e0-591f-419b-8959-5a01735f9618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:16 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-2b76a2b1-8d7a-4da9-9e24-8e4ae8b59445 tempest-TestInstancesWithCinderVolumes-2052085588 None] Created volume successfully. Sep 04 16:00:16 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4d4b3d1d-061f-4f7e-aa3c-094e8e89d972 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2.452e50b6-44f0-4a58-aa8b-98992a387c2e" returned: 0 in 0.378s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4d4b3d1d-061f-4f7e-aa3c-094e8e89d972 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2.452e50b6-44f0-4a58-aa8b-98992a387c2e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:16 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2.452e50b6-44f0-4a58-aa8b-98992a387c2e Sep 04 16:00:16 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:16 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4d4b3d1d-061f-4f7e-aa3c-094e8e89d972 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2.452e50b6-44f0-4a58-aa8b-98992a387c2e" returned: 0 in 0.304s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:17 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4d4b3d1d-061f-4f7e-aa3c-094e8e89d972 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Lock "cinder-quobyte-452e50b6-44f0-4a58-aa8b-98992a387c2e" released by "_delete_snapshot" :: held 1.785s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:17 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4d4b3d1d-061f-4f7e-aa3c-094e8e89d972 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Lock "cinder-quobyte-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2" released by "delete_snapshot" :: held 1.816s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:17 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-4d4b3d1d-061f-4f7e-aa3c-094e8e89d972 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Created reservations ['a9b6b424-01f1-402f-a8a6-9d760056c635', 'e8600c83-ad1f-4ed2-9dbd-ca6eafd9f57b', 'b000d204-5ac0-4da3-9b88-ce8b5f7b8364', 'a308b806-13b1-4628-bbb6-6686fb3e7009'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:00:17 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-4d4b3d1d-061f-4f7e-aa3c-094e8e89d972 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Delete snapshot completed successfully. Sep 04 16:00:17 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4d4b3d1d-061f-4f7e-aa3c-094e8e89d972 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Lock "cinder-452e50b6-44f0-4a58-aa8b-98992a387c2e-delete_snapshot" released by "delete_snapshot" :: held 1.979s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:17 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3766b9a5-18f1-4ef5-ac26-c2f506619280 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Acquiring lock "cinder-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:17 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3766b9a5-18f1-4ef5-ac26-c2f506619280 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Lock "cinder-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:17 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3766b9a5-18f1-4ef5-ac26-c2f506619280 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Acquiring lock "cinder-quobyte-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:00:17 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3766b9a5-18f1-4ef5-ac26-c2f506619280 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Lock "cinder-quobyte-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2" acquired by "delete_volume" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:00:17 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30bb7b8-a9ae-492c-bf81-6764677d2d7e]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3766b9a5-18f1-4ef5-ac26-c2f506619280 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:17 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2 Sep 04 16:00:17 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:17 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3766b9a5-18f1-4ef5-ac26-c2f506619280 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2" returned: 0 in 0.432s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3766b9a5-18f1-4ef5-ac26-c2f506619280 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:17 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2 Sep 04 16:00:17 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:18 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_68lwk1p1devstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e7905871-ed5e-4b14-aa67-5b87b622217d" returned: 0 in 1.858s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:18 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5558c17-c499-44af-95fb-afb0cb03a012_68lwk1p1devstack@QuobyteHD, size 112.00 MB, duration 1.86 sec, destination /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e7905871-ed5e-4b14-aa67-5b87b622217d {{(pid=87490) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 16:00:18 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Converted 112.00 MB image at 60.23 MB/s Sep 04 16:00:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e7905871-ed5e-4b14-aa67-5b87b622217d 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:18 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e7905871-ed5e-4b14-aa67-5b87b622217d 1G Sep 04 16:00:18 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:18 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3766b9a5-18f1-4ef5-ac26-c2f506619280 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2" returned: 0 in 0.254s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:18 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3766b9a5-18f1-4ef5-ac26-c2f506619280 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Lock "cinder-quobyte-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2" released by "delete_volume" :: held 0.750s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:18 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-3766b9a5-18f1-4ef5-ac26-c2f506619280 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Created reservations ['76022c60-761d-4c00-b2e1-881428f561bd', '4ffbdc8b-982e-4601-91f2-3dd2c9614d84', 'ac86f875-d6a1-4d2b-a565-fe1ac0f6160b', 'dfe4915f-d886-42e7-884f-6f145f967361'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:00:18 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e7905871-ed5e-4b14-aa67-5b87b622217d 1G" returned: 0 in 0.336s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:18 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Downloaded image b5558c17-c499-44af-95fb-afb0cb03a012 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}])) to volume e7905871-ed5e-4b14-aa67-5b87b622217d successfully. {{(pid=87490) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 16:00:18 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Temporary image b5558c17-c499-44af-95fb-afb0cb03a012 for user fe0bcefa451b4d8bb5f616278806258d is deleted. {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 16:00:18 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Marking volume e7905871-ed5e-4b14-aa67-5b87b622217d as bootable. {{(pid=87490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 16:00:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3766b9a5-18f1-4ef5-ac26-c2f506619280 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3766b9a5-18f1-4ef5-ac26-c2f506619280 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3766b9a5-18f1-4ef5-ac26-c2f506619280 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:00:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3766b9a5-18f1-4ef5-ac26-c2f506619280 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:00:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3766b9a5-18f1-4ef5-ac26-c2f506619280 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3766b9a5-18f1-4ef5-ac26-c2f506619280 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:18 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Copying metadata from image b5558c17-c499-44af-95fb-afb0cb03a012 to e7905871-ed5e-4b14-aa67-5b87b622217d. {{(pid=87490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 16:00:18 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Creating volume glance metadata for volume e7905871-ed5e-4b14-aa67-5b87b622217d backed by image b5558c17-c499-44af-95fb-afb0cb03a012 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87490) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 16:00:18 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:00:18 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b7ffc6-5518-489f-aa06-4dcc44227e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7905871-ed5e-4b14-aa67-5b87b622217d', 'volume_size': 1, 'image_id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5558c17-c499-44af-95fb-afb0cb03a012', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f11b89ae18364ea089a6f8a208910da3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5558c17-c499-44af-95fb-afb0cb03a012', 'created_at': datetime.datetime(2026, 9, 4, 13, 42, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 13, 42, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5558c17-c499-44af-95fb-afb0cb03a012/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe9946b-1ae8-4cf0-b53d-a3df3d1de8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:18 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Volume volume-e7905871-ed5e-4b14-aa67-5b87b622217d (e7905871-ed5e-4b14-aa67-5b87b622217d): created successfully Sep 04 16:00:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe9946b-1ae8-4cf0-b53d-a3df3d1de8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Flow 'volume_create_manager' (ff58c6ca-6e3e-403d-a40a-d0070918ba01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:18 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-434f8a1e-8277-4ef8-8527-933190a3871c tempest-TestShelveInstance-313521521 None] Created volume successfully. Sep 04 16:00:18 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3766b9a5-18f1-4ef5-ac26-c2f506619280 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.283s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:18 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-3766b9a5-18f1-4ef5-ac26-c2f506619280 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:00:18 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-3766b9a5-18f1-4ef5-ac26-c2f506619280 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Deleted volume successfully. Sep 04 16:00:18 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3766b9a5-18f1-4ef5-ac26-c2f506619280 tempest-VolumesSnapshotNegativeTestJSON-785971088 None] Lock "cinder-04ec8c4d-347a-4e53-b0a9-f48eefa9d4c2-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:00:20 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_907ca86f-6a52-4671-a135-80b48d6432d5_tzfs8wy6devstack@QuobyteHD, size 20.69 MB, duration 4.22 sec {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 16:00:20 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Image download 20.69 MB at 4.91 MB/s Sep 04 16:00:20 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebaaad7-c36e-4b85-b462-688e5dfba09a]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_907ca86f-6a52-4671-a135-80b48d6432d5_tzfs8wy6devstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:20 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_907ca86f-6a52-4671-a135-80b48d6432d5_tzfs8wy6devstack@QuobyteHD Sep 04 16:00:20 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:20 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_907ca86f-6a52-4671-a135-80b48d6432d5_tzfs8wy6devstack@QuobyteHD" returned: 0 in 0.401s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:20 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Temporary image 907ca86f-6a52-4671-a135-80b48d6432d5 is fetched for user 057e355e5ff14d78a0b9658cd3ed9eb2. {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 16:00:20 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eebdfa4-b547-4ecf-b954-e869425fa54e]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_907ca86f-6a52-4671-a135-80b48d6432d5_tzfs8wy6devstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:20 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_907ca86f-6a52-4671-a135-80b48d6432d5_tzfs8wy6devstack@QuobyteHD Sep 04 16:00:20 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:21 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_907ca86f-6a52-4671-a135-80b48d6432d5_tzfs8wy6devstack@QuobyteHD" returned: 0 in 0.422s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:21 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-614788466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8140622d-98b7-4557-bf92-a30756c9a8e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd72477c59e6474fb8eb4a38c8be76b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:16Z,use_quota=True,user_id='057e355e5ff14d78a0b9658cd3ed9eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b813fde-6333-4a72-8276-1b2a48945377),volume_type_id=9b813fde-6333-4a72-8276-1b2a48945377)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:00:21 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Creating volume 8140622d-98b7-4557-bf92-a30756c9a8e9 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:00:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:21 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:00:21 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:00:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:21 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:00:21 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:00:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8140622d-98b7-4557-bf92-a30756c9a8e9 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:21 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8140622d-98b7-4557-bf92-a30756c9a8e9 1073741824 Sep 04 16:00:21 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:21 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8140622d-98b7-4557-bf92-a30756c9a8e9 1073741824" returned: 0 in 0.546s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8140622d-98b7-4557-bf92-a30756c9a8e9 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:21 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8140622d-98b7-4557-bf92-a30756c9a8e9 Sep 04 16:00:21 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-f674ea33-90dd-438f-9249-c17f29a1e8f7 req-43ae3725-707f-42a6-aebb-462acadb4e30 tempest-TestShelveInstance-313521521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:22 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8140622d-98b7-4557-bf92-a30756c9a8e9" returned: 0 in 0.329s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:00:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-f674ea33-90dd-438f-9249-c17f29a1e8f7 req-43ae3725-707f-42a6-aebb-462acadb4e30 tempest-TestShelveInstance-313521521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.270s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-f674ea33-90dd-438f-9249-c17f29a1e8f7 req-43ae3725-707f-42a6-aebb-462acadb4e30 tempest-TestShelveInstance-313521521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:22 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Attempting download of 907ca86f-6a52-4671-a135-80b48d6432d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/907ca86f-6a52-4671-a135-80b48d6432d5', 'metadata': {}}])) to volume 8140622d-98b7-4557-bf92-a30756c9a8e9. {{(pid=87490) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 16:00:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-f674ea33-90dd-438f-9249-c17f29a1e8f7 req-43ae3725-707f-42a6-aebb-462acadb4e30 tempest-TestShelveInstance-313521521 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787', 'name': 'volume-e7905871-ed5e-4b14-aa67-5b87b622217d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '849a6695-5974-44f8-85a8-f1fe0d9459f3', 'enforce_multipath': True} {{(pid=87490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 16:00:22 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f7b13d-34ba-4f64-9db8-6849fe6ddf6a]: (4, 'raw') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_907ca86f-6a52-4671-a135-80b48d6432d5_kpkbjwlf {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:22 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-f674ea33-90dd-438f-9249-c17f29a1e8f7 req-43ae3725-707f-42a6-aebb-462acadb4e30 tempest-TestShelveInstance-313521521 None] attachment_update completed successfully. Sep 04 16:00:22 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_907ca86f-6a52-4671-a135-80b48d6432d5_kpkbjwlf Sep 04 16:00:22 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:22 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_907ca86f-6a52-4671-a135-80b48d6432d5_kpkbjwlf" returned: 0 in 0.522s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_907ca86f-6a52-4671-a135-80b48d6432d5_kpkbjwlf {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:22 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_907ca86f-6a52-4671-a135-80b48d6432d5_kpkbjwlf Sep 04 16:00:22 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:23 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_907ca86f-6a52-4671-a135-80b48d6432d5_kpkbjwlf" returned: 1 in 0.442s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_907ca86f-6a52-4671-a135-80b48d6432d5_kpkbjwlf' failed. Not Retrying. {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:00:23 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[284f2894-cd60-4113-8f42-f2f8855b7e58]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_907ca86f-6a52-4671-a135-80b48d6432d5_tzfs8wy6devstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:23 devstack sudo[100409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_907ca86f-6a52-4671-a135-80b48d6432d5_tzfs8wy6devstack@QuobyteHD Sep 04 16:00:23 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:23 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_907ca86f-6a52-4671-a135-80b48d6432d5_tzfs8wy6devstack@QuobyteHD" returned: 0 in 0.398s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:23 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] 907ca86f-6a52-4671-a135-80b48d6432d5 was qcow2, converting to qcow2 {{(pid=87490) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 16:00:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_907ca86f-6a52-4671-a135-80b48d6432d5_tzfs8wy6devstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8140622d-98b7-4557-bf92-a30756c9a8e9 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:23 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_907ca86f-6a52-4671-a135-80b48d6432d5_tzfs8wy6devstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8140622d-98b7-4557-bf92-a30756c9a8e9 Sep 04 16:00:23 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:26 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_907ca86f-6a52-4671-a135-80b48d6432d5_tzfs8wy6devstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8140622d-98b7-4557-bf92-a30756c9a8e9" returned: 0 in 2.676s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:26 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_907ca86f-6a52-4671-a135-80b48d6432d5_tzfs8wy6devstack@QuobyteHD, size 112.00 MB, duration 2.68 sec, destination /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8140622d-98b7-4557-bf92-a30756c9a8e9 {{(pid=87490) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 16:00:26 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Converted 112.00 MB image at 41.79 MB/s Sep 04 16:00:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8140622d-98b7-4557-bf92-a30756c9a8e9 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:26 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8140622d-98b7-4557-bf92-a30756c9a8e9 1G Sep 04 16:00:26 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:26 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8140622d-98b7-4557-bf92-a30756c9a8e9 1G" returned: 0 in 0.448s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:26 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Downloaded image 907ca86f-6a52-4671-a135-80b48d6432d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/907ca86f-6a52-4671-a135-80b48d6432d5', 'metadata': {}}])) to volume 8140622d-98b7-4557-bf92-a30756c9a8e9 successfully. {{(pid=87490) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 16:00:26 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Temporary image 907ca86f-6a52-4671-a135-80b48d6432d5 for user 057e355e5ff14d78a0b9658cd3ed9eb2 is deleted. {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 16:00:26 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Marking volume 8140622d-98b7-4557-bf92-a30756c9a8e9 as bootable. {{(pid=87490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 16:00:26 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Copying metadata from image 907ca86f-6a52-4671-a135-80b48d6432d5 to 8140622d-98b7-4557-bf92-a30756c9a8e9. {{(pid=87490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 16:00:26 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Creating volume glance metadata for volume 8140622d-98b7-4557-bf92-a30756c9a8e9 backed by image 907ca86f-6a52-4671-a135-80b48d6432d5 with: {'image_id': '907ca86f-6a52-4671-a135-80b48d6432d5', 'image_name': 'tempest-scenario-img--528246234', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87490) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 16:00:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (545c7bf1-2dae-4e2b-b3f5-3840a4ab495a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8140622d-98b7-4557-bf92-a30756c9a8e9', 'volume_size': 1, 'image_id': '907ca86f-6a52-4671-a135-80b48d6432d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/907ca86f-6a52-4671-a135-80b48d6432d5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--528246234', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dd72477c59e6474fb8eb4a38c8be76b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '907ca86f-6a52-4671-a135-80b48d6432d5', 'created_at': datetime.datetime(2026, 9, 4, 14, 0, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 0, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/907ca86f-6a52-4671-a135-80b48d6432d5/file', 'properties': {}}, 'image_service': }' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae1cb888-bc1c-430c-a6ca-dd6f70c7c44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:27 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Volume volume-8140622d-98b7-4557-bf92-a30756c9a8e9 (8140622d-98b7-4557-bf92-a30756c9a8e9): created successfully Sep 04 16:00:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae1cb888-bc1c-430c-a6ca-dd6f70c7c44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Flow 'volume_create_manager' (84ca9b81-17c0-4ea0-87d8-22aec004f513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:27 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-cbbbaa79-abdc-46e5-a35a-c95db38ca07f tempest-TestInstancesWithCinderVolumes-2052085588 None] Created volume successfully. Sep 04 16:00:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-4f425f35-7c93-4f60-bb8a-e6d0d0897a9c req-84cfde67-2219-4b52-9560-2f09dfed1ad1 tempest-TestInstancesWithCinderVolumes-2052085588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-4f425f35-7c93-4f60-bb8a-e6d0d0897a9c req-84cfde67-2219-4b52-9560-2f09dfed1ad1 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-4f425f35-7c93-4f60-bb8a-e6d0d0897a9c req-84cfde67-2219-4b52-9560-2f09dfed1ad1 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-4f425f35-7c93-4f60-bb8a-e6d0d0897a9c req-84cfde67-2219-4b52-9560-2f09dfed1ad1 tempest-TestInstancesWithCinderVolumes-2052085588 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787', 'name': 'volume-8140622d-98b7-4557-bf92-a30756c9a8e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b20bad18-7303-4b4a-8c23-d8e68708fcef', 'enforce_multipath': True} {{(pid=87490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 16:00:32 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=118,cinder:INSERT=47,cinder:UPDATE=133,cinder:DELETE=10 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:00:32 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=114,cinder:DELETE=10,cinder:INSERT=49,cinder:UPDATE=121 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:00:32 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-4f425f35-7c93-4f60-bb8a-e6d0d0897a9c req-84cfde67-2219-4b52-9560-2f09dfed1ad1 tempest-TestInstancesWithCinderVolumes-2052085588 None] attachment_update completed successfully. Sep 04 16:00:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:00:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:00:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:00:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:38 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:00:38 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:38 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.449s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:38 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:00:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager._thread_info {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:00:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread count: 28 {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 16:00:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread info: [<_MainThread(MainThread, started 138899118923904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 16:00:42 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:00:50 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:00:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Flow 'volume_create_manager' (3837be39-3e82-4e75-aa87-4732da04c0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32641ebc-e57e-4353-a165-9ffc0b92ebbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32641ebc-e57e-4353-a165-9ffc0b92ebbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1849846406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=960febe2-ca16-4130-a65c-7eaf75311ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='384d8a2dd7874c089a75681a760f6ad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:50Z,use_quota=True,user_id='2f815a78406f40bda1341aaa8773bd65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf740572-cc57-41ec-8299-179305233adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf740572-cc57-41ec-8299-179305233adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (711adde3-4c63-4ad1-b2f7-4e6b4f06e63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (711adde3-4c63-4ad1-b2f7-4e6b4f06e63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '960febe2-ca16-4130-a65c-7eaf75311ac8', 'volume_name': 'volume-960febe2-ca16-4130-a65c-7eaf75311ac8', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35437033-7be2-4eb3-8839-06f2a6dad983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35437033-7be2-4eb3-8839-06f2a6dad983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a644a20e-a08a-4d1e-8d04-08f71504be6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:50 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Volume 960febe2-ca16-4130-a65c-7eaf75311ac8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-960febe2-ca16-4130-a65c-7eaf75311ac8', 'volume_size': 1} Sep 04 16:00:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1849846406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=960febe2-ca16-4130-a65c-7eaf75311ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='384d8a2dd7874c089a75681a760f6ad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:00:50Z,use_quota=True,user_id='2f815a78406f40bda1341aaa8773bd65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:00:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Creating volume 960febe2-ca16-4130-a65c-7eaf75311ac8 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:00:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:00:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:00:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:00:50 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:00:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-960febe2-ca16-4130-a65c-7eaf75311ac8 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:50 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-960febe2-ca16-4130-a65c-7eaf75311ac8 1073741824 Sep 04 16:00:50 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:50 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-960febe2-ca16-4130-a65c-7eaf75311ac8 1073741824" returned: 0 in 0.580s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-960febe2-ca16-4130-a65c-7eaf75311ac8 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:50 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-960febe2-ca16-4130-a65c-7eaf75311ac8 Sep 04 16:00:50 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:51 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-960febe2-ca16-4130-a65c-7eaf75311ac8" returned: 0 in 0.431s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:51 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:00:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:00:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a644a20e-a08a-4d1e-8d04-08f71504be6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-960febe2-ca16-4130-a65c-7eaf75311ac8', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f234d0d-ac16-4d8e-9f25-6d536b09b7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:00:51 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Volume volume-960febe2-ca16-4130-a65c-7eaf75311ac8 (960febe2-ca16-4130-a65c-7eaf75311ac8): created successfully Sep 04 16:00:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f234d0d-ac16-4d8e-9f25-6d536b09b7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:00:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Flow 'volume_create_manager' (3837be39-3e82-4e75-aa87-4732da04c0ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:00:51 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-a5ff00c8-5a44-4d01-83e8-16cb1ab07edb tempest-TestImageHashVerification-604314658 None] Created volume successfully. Sep 04 16:00:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0c43e207-74d9-4cf3-a50f-a3b65c74ef9f tempest-TestImageHashVerification-604314658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:00:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0c43e207-74d9-4cf3-a50f-a3b65c74ef9f tempest-TestImageHashVerification-604314658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:00:53 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1d62c1-3b45-4671-a40f-24679cb1ff68]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0c43e207-74d9-4cf3-a50f-a3b65c74ef9f tempest-TestImageHashVerification-604314658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-960febe2-ca16-4130-a65c-7eaf75311ac8 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:53 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-960febe2-ca16-4130-a65c-7eaf75311ac8 Sep 04 16:00:53 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:53 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0c43e207-74d9-4cf3-a50f-a3b65c74ef9f tempest-TestImageHashVerification-604314658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-960febe2-ca16-4130-a65c-7eaf75311ac8" returned: 0 in 0.394s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:53 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[101431f6-0780-481d-b710-5077a4cc9afa]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0c43e207-74d9-4cf3-a50f-a3b65c74ef9f tempest-TestImageHashVerification-604314658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-960febe2-ca16-4130-a65c-7eaf75311ac8 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:53 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-960febe2-ca16-4130-a65c-7eaf75311ac8 Sep 04 16:00:53 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:53 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0c43e207-74d9-4cf3-a50f-a3b65c74ef9f tempest-TestImageHashVerification-604314658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-960febe2-ca16-4130-a65c-7eaf75311ac8" returned: 0 in 0.347s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0c43e207-74d9-4cf3-a50f-a3b65c74ef9f tempest-TestImageHashVerification-604314658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-960febe2-ca16-4130-a65c-7eaf75311ac8 /opt/stack/data/cinder/conversion/960febe2-ca16-4130-a65c-7eaf75311ac8.temp_image.dbf720d2-ab6e-4e01-a0e5-fb2fd4136841e9hmod47.img {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:54 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-960febe2-ca16-4130-a65c-7eaf75311ac8 /opt/stack/data/cinder/conversion/960febe2-ca16-4130-a65c-7eaf75311ac8.temp_image.dbf720d2-ab6e-4e01-a0e5-fb2fd4136841e9hmod47.img Sep 04 16:00:54 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:00:59 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Sep 04 16:00:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0c43e207-74d9-4cf3-a50f-a3b65c74ef9f tempest-TestImageHashVerification-604314658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-960febe2-ca16-4130-a65c-7eaf75311ac8 /opt/stack/data/cinder/conversion/960febe2-ca16-4130-a65c-7eaf75311ac8.temp_image.dbf720d2-ab6e-4e01-a0e5-fb2fd4136841e9hmod47.img" returned: 0 in 5.764s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:00:59 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a090146-c35f-45be-893d-947ebbc1b416]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:00:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0c43e207-74d9-4cf3-a50f-a3b65c74ef9f tempest-TestImageHashVerification-604314658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-960febe2-ca16-4130-a65c-7eaf75311ac8 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:00:59 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-960febe2-ca16-4130-a65c-7eaf75311ac8 Sep 04 16:00:59 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:00 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-6317ef54-bf4f-4048-b47b-e64d74a51577 req-3742c616-d6fc-4597-82f1-643dd71a858a tempest-TestShelveInstance-313521521 None] Terminate volume connection completed successfully. Sep 04 16:01:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-6317ef54-bf4f-4048-b47b-e64d74a51577 req-3742c616-d6fc-4597-82f1-643dd71a858a tempest-TestShelveInstance-313521521 None] Deleting attachment 849a6695-5974-44f8-85a8-f1fe0d9459f3. {{(pid=87490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 16:01:00 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0c43e207-74d9-4cf3-a50f-a3b65c74ef9f tempest-TestImageHashVerification-604314658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-960febe2-ca16-4130-a65c-7eaf75311ac8" returned: 0 in 0.871s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:00 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-0c43e207-74d9-4cf3-a50f-a3b65c74ef9f tempest-TestImageHashVerification-604314658 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-960febe2-ca16-4130-a65c-7eaf75311ac8, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/conversion/960febe2-ca16-4130-a65c-7eaf75311ac8.temp_image.dbf720d2-ab6e-4e01-a0e5-fb2fd4136841e9hmod47.img {{(pid=87490) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 16:01:00 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-0c43e207-74d9-4cf3-a50f-a3b65c74ef9f tempest-TestImageHashVerification-604314658 None] Converted 1024.00 MB image at 177.63 MB/s Sep 04 16:01:00 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-0c43e207-74d9-4cf3-a50f-a3b65c74ef9f tempest-TestImageHashVerification-604314658 None] dbf720d2-ab6e-4e01-a0e5-fb2fd4136841 was raw, no need to convert to raw {{(pid=87490) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 04 16:01:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-d66a052e-e0db-4b13-abc9-d84fb0827ad1 req-ce177292-19a7-485b-a162-a664857c642c tempest-TestShelveInstance-313521521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:12 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:UPDATE=2,cinder:SELECT=4,cinder:INSERT=1 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:01:12 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:01:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-f205c9ed-ec59-4fac-932d-543c0eb5e6c9 req-706a324d-9631-45c2-befd-15d8c365733d tempest-TestInstancesWithCinderVolumes-2052085588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0c43e207-74d9-4cf3-a50f-a3b65c74ef9f tempest-TestImageHashVerification-604314658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.140s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:20 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0c43e207-74d9-4cf3-a50f-a3b65c74ef9f tempest-TestImageHashVerification-604314658 None] Uploaded volume to glance image-id: dbf720d2-ab6e-4e01-a0e5-fb2fd4136841. {{(pid=87490) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 04 16:01:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-d66a052e-e0db-4b13-abc9-d84fb0827ad1 req-ce177292-19a7-485b-a162-a664857c642c tempest-TestShelveInstance-313521521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 17.952s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-d66a052e-e0db-4b13-abc9-d84fb0827ad1 req-ce177292-19a7-485b-a162-a664857c642c tempest-TestShelveInstance-313521521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-f205c9ed-ec59-4fac-932d-543c0eb5e6c9 req-706a324d-9631-45c2-befd-15d8c365733d tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.846s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-f205c9ed-ec59-4fac-932d-543c0eb5e6c9 req-706a324d-9631-45c2-befd-15d8c365733d tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:20 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-0c43e207-74d9-4cf3-a50f-a3b65c74ef9f tempest-TestImageHashVerification-604314658 None] Copy volume to image completed successfully. Sep 04 16:01:20 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-d66a052e-e0db-4b13-abc9-d84fb0827ad1 req-ce177292-19a7-485b-a162-a664857c642c tempest-TestShelveInstance-313521521 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787', 'name': 'volume-e7905871-ed5e-4b14-aa67-5b87b622217d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ec0cbdd-9448-4d20-a17a-63bc16899a57', 'enforce_multipath': True} {{(pid=87490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 16:01:20 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-f205c9ed-ec59-4fac-932d-543c0eb5e6c9 req-706a324d-9631-45c2-befd-15d8c365733d tempest-TestInstancesWithCinderVolumes-2052085588 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787', 'name': 'volume-cc73a763-601b-4b0a-9f91-3b8f938bcf92', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca44783d-3ed0-4216-b714-036ffdb4c018', 'enforce_multipath': True} {{(pid=87490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 16:01:20 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-d66a052e-e0db-4b13-abc9-d84fb0827ad1 req-ce177292-19a7-485b-a162-a664857c642c tempest-TestShelveInstance-313521521 None] attachment_update completed successfully. Sep 04 16:01:20 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-f205c9ed-ec59-4fac-932d-543c0eb5e6c9 req-706a324d-9631-45c2-befd-15d8c365733d tempest-TestInstancesWithCinderVolumes-2052085588 None] attachment_update completed successfully. Sep 04 16:01:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed4cb36f-7421-4bdd-a05a-815bd61bb1e6 tempest-TestImageHashVerification-604314658 None] Acquiring lock "cinder-960febe2-ca16-4130-a65c-7eaf75311ac8-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed4cb36f-7421-4bdd-a05a-815bd61bb1e6 tempest-TestImageHashVerification-604314658 None] Lock "cinder-960febe2-ca16-4130-a65c-7eaf75311ac8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed4cb36f-7421-4bdd-a05a-815bd61bb1e6 tempest-TestImageHashVerification-604314658 None] Acquiring lock "cinder-quobyte-960febe2-ca16-4130-a65c-7eaf75311ac8" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed4cb36f-7421-4bdd-a05a-815bd61bb1e6 tempest-TestImageHashVerification-604314658 None] Lock "cinder-quobyte-960febe2-ca16-4130-a65c-7eaf75311ac8" acquired by "delete_volume" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:21 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1c6344-4713-43c4-bb61-2d8f18a91d1f]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:01:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed4cb36f-7421-4bdd-a05a-815bd61bb1e6 tempest-TestImageHashVerification-604314658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-960febe2-ca16-4130-a65c-7eaf75311ac8 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:21 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-960febe2-ca16-4130-a65c-7eaf75311ac8 Sep 04 16:01:21 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:21 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed4cb36f-7421-4bdd-a05a-815bd61bb1e6 tempest-TestImageHashVerification-604314658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-960febe2-ca16-4130-a65c-7eaf75311ac8" returned: 0 in 0.405s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed4cb36f-7421-4bdd-a05a-815bd61bb1e6 tempest-TestImageHashVerification-604314658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-960febe2-ca16-4130-a65c-7eaf75311ac8 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:21 devstack sudo[101168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-960febe2-ca16-4130-a65c-7eaf75311ac8 Sep 04 16:01:21 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:22 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed4cb36f-7421-4bdd-a05a-815bd61bb1e6 tempest-TestImageHashVerification-604314658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-960febe2-ca16-4130-a65c-7eaf75311ac8" returned: 0 in 0.327s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed4cb36f-7421-4bdd-a05a-815bd61bb1e6 tempest-TestImageHashVerification-604314658 None] Lock "cinder-quobyte-960febe2-ca16-4130-a65c-7eaf75311ac8" released by "delete_volume" :: held 0.797s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:22 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-ed4cb36f-7421-4bdd-a05a-815bd61bb1e6 tempest-TestImageHashVerification-604314658 None] Created reservations ['c462a8f3-3d05-4490-a119-19a68fe8e02b', '617bf05c-99b6-4b7e-8cca-ddefdffdea50', '5860cd41-480b-4f80-890e-fe59e3181ef7', '17e9f45a-3b1d-43a0-b96c-0af474b7be2a'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:01:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ed4cb36f-7421-4bdd-a05a-815bd61bb1e6 tempest-TestImageHashVerification-604314658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ed4cb36f-7421-4bdd-a05a-815bd61bb1e6 tempest-TestImageHashVerification-604314658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ed4cb36f-7421-4bdd-a05a-815bd61bb1e6 tempest-TestImageHashVerification-604314658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:01:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ed4cb36f-7421-4bdd-a05a-815bd61bb1e6 tempest-TestImageHashVerification-604314658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:01:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ed4cb36f-7421-4bdd-a05a-815bd61bb1e6 tempest-TestImageHashVerification-604314658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed4cb36f-7421-4bdd-a05a-815bd61bb1e6 tempest-TestImageHashVerification-604314658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:22 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:01:22 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:22 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ed4cb36f-7421-4bdd-a05a-815bd61bb1e6 tempest-TestImageHashVerification-604314658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.483s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:22 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-ed4cb36f-7421-4bdd-a05a-815bd61bb1e6 tempest-TestImageHashVerification-604314658 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:01:22 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-ed4cb36f-7421-4bdd-a05a-815bd61bb1e6 tempest-TestImageHashVerification-604314658 None] Deleted volume successfully. Sep 04 16:01:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ed4cb36f-7421-4bdd-a05a-815bd61bb1e6 tempest-TestImageHashVerification-604314658 None] Lock "cinder-960febe2-ca16-4130-a65c-7eaf75311ac8-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-24c8a4e7-10d1-40b4-a5af-8e2b9cd6d879 req-9e227807-8971-4eee-9114-f66dd0366677 tempest-TestInstancesWithCinderVolumes-2052085588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-24c8a4e7-10d1-40b4-a5af-8e2b9cd6d879 req-9e227807-8971-4eee-9114-f66dd0366677 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-24c8a4e7-10d1-40b4-a5af-8e2b9cd6d879 req-9e227807-8971-4eee-9114-f66dd0366677 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-24c8a4e7-10d1-40b4-a5af-8e2b9cd6d879 req-9e227807-8971-4eee-9114-f66dd0366677 tempest-TestInstancesWithCinderVolumes-2052085588 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787', 'name': 'volume-f911dd81-bf8c-4124-902c-c51a56d7db69', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '035ce77f-e752-4475-8985-3b296a53ff7c', 'enforce_multipath': True} {{(pid=87490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 16:01:23 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-24c8a4e7-10d1-40b4-a5af-8e2b9cd6d879 req-9e227807-8971-4eee-9114-f66dd0366677 tempest-TestInstancesWithCinderVolumes-2052085588 None] attachment_update completed successfully. Sep 04 16:01:30 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-3125c5dd-b579-4905-9538-557f6b9c0082 req-96881e3c-98c0-4e7a-83ca-cb185ca3a67f tempest-TestInstancesWithCinderVolumes-2052085588 None] Terminate volume connection completed successfully. Sep 04 16:01:30 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-3125c5dd-b579-4905-9538-557f6b9c0082 req-96881e3c-98c0-4e7a-83ca-cb185ca3a67f tempest-TestInstancesWithCinderVolumes-2052085588 None] Deleting attachment ca44783d-3ed0-4216-b714-036ffdb4c018. {{(pid=87490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 16:01:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-15d49fc8-14bd-4072-bc3c-17d400ccac99 tempest-TestInstancesWithCinderVolumes-2052085588 None] Acquiring lock "cinder-cc73a763-601b-4b0a-9f91-3b8f938bcf92-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-15d49fc8-14bd-4072-bc3c-17d400ccac99 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "cinder-cc73a763-601b-4b0a-9f91-3b8f938bcf92-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-15d49fc8-14bd-4072-bc3c-17d400ccac99 tempest-TestInstancesWithCinderVolumes-2052085588 None] Acquiring lock "cinder-quobyte-cc73a763-601b-4b0a-9f91-3b8f938bcf92" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-15d49fc8-14bd-4072-bc3c-17d400ccac99 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "cinder-quobyte-cc73a763-601b-4b0a-9f91-3b8f938bcf92" acquired by "delete_volume" :: waited 0.027s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:31 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b93bca-9a11-4b0b-8ae4-5419d7bd7349]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:01:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-15d49fc8-14bd-4072-bc3c-17d400ccac99 tempest-TestInstancesWithCinderVolumes-2052085588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cc73a763-601b-4b0a-9f91-3b8f938bcf92 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:31 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cc73a763-601b-4b0a-9f91-3b8f938bcf92 Sep 04 16:01:31 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:31 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-15d49fc8-14bd-4072-bc3c-17d400ccac99 tempest-TestInstancesWithCinderVolumes-2052085588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cc73a763-601b-4b0a-9f91-3b8f938bcf92" returned: 0 in 0.571s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-15d49fc8-14bd-4072-bc3c-17d400ccac99 tempest-TestInstancesWithCinderVolumes-2052085588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cc73a763-601b-4b0a-9f91-3b8f938bcf92 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:32 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cc73a763-601b-4b0a-9f91-3b8f938bcf92 Sep 04 16:01:32 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:32 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-15d49fc8-14bd-4072-bc3c-17d400ccac99 tempest-TestInstancesWithCinderVolumes-2052085588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cc73a763-601b-4b0a-9f91-3b8f938bcf92" returned: 0 in 0.323s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-15d49fc8-14bd-4072-bc3c-17d400ccac99 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "cinder-quobyte-cc73a763-601b-4b0a-9f91-3b8f938bcf92" released by "delete_volume" :: held 0.960s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:32 devstack cinder-volume[87490]: WARNING cinder.quota [None req-15d49fc8-14bd-4072-bc3c-17d400ccac99 tempest-TestInstancesWithCinderVolumes-2052085588 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-886154105-1161559734 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-886154105-1161559734, it is now deprecated. Please use the default quota class for default quota. Sep 04 16:01:32 devstack cinder-volume[87490]: WARNING cinder.quota [None req-15d49fc8-14bd-4072-bc3c-17d400ccac99 tempest-TestInstancesWithCinderVolumes-2052085588 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-886154105-1161559734 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-886154105-1161559734, it is now deprecated. Please use the default quota class for default quota. Sep 04 16:01:32 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-15d49fc8-14bd-4072-bc3c-17d400ccac99 tempest-TestInstancesWithCinderVolumes-2052085588 None] Created reservations ['a69c1877-68a3-45c2-ba94-4195162bc09b', '8cca94b2-698a-48c9-a849-45e259f36e19', '369a0240-2e17-4777-aab4-7a02ec1fec90', 'ca7248bb-01cf-42f4-b6d0-c3fc2fa27716'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:01:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-15d49fc8-14bd-4072-bc3c-17d400ccac99 tempest-TestInstancesWithCinderVolumes-2052085588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-15d49fc8-14bd-4072-bc3c-17d400ccac99 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-15d49fc8-14bd-4072-bc3c-17d400ccac99 tempest-TestInstancesWithCinderVolumes-2052085588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:01:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-15d49fc8-14bd-4072-bc3c-17d400ccac99 tempest-TestInstancesWithCinderVolumes-2052085588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:01:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-15d49fc8-14bd-4072-bc3c-17d400ccac99 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-15d49fc8-14bd-4072-bc3c-17d400ccac99 tempest-TestInstancesWithCinderVolumes-2052085588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:32 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:01:32 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:32 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-15d49fc8-14bd-4072-bc3c-17d400ccac99 tempest-TestInstancesWithCinderVolumes-2052085588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.282s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:32 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-15d49fc8-14bd-4072-bc3c-17d400ccac99 tempest-TestInstancesWithCinderVolumes-2052085588 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:01:32 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-15d49fc8-14bd-4072-bc3c-17d400ccac99 tempest-TestInstancesWithCinderVolumes-2052085588 None] Deleted volume successfully. Sep 04 16:01:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-15d49fc8-14bd-4072-bc3c-17d400ccac99 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "cinder-cc73a763-601b-4b0a-9f91-3b8f938bcf92-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:35 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-58b6cf5b-ab26-41de-a223-ec4813d0e330 req-ffc43060-ad5e-438c-8cc9-4aa83ba8e8ea tempest-TestInstancesWithCinderVolumes-2052085588 None] Terminate volume connection completed successfully. Sep 04 16:01:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-58b6cf5b-ab26-41de-a223-ec4813d0e330 req-ffc43060-ad5e-438c-8cc9-4aa83ba8e8ea tempest-TestInstancesWithCinderVolumes-2052085588 None] Deleting attachment 035ce77f-e752-4475-8985-3b296a53ff7c. {{(pid=87490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 16:01:36 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0958deb9-8b6c-472e-af03-7a2d329a0161 tempest-TestInstancesWithCinderVolumes-2052085588 None] Acquiring lock "cinder-f911dd81-bf8c-4124-902c-c51a56d7db69-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:36 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0958deb9-8b6c-472e-af03-7a2d329a0161 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "cinder-f911dd81-bf8c-4124-902c-c51a56d7db69-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:36 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0958deb9-8b6c-472e-af03-7a2d329a0161 tempest-TestInstancesWithCinderVolumes-2052085588 None] Acquiring lock "cinder-quobyte-f911dd81-bf8c-4124-902c-c51a56d7db69" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:36 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0958deb9-8b6c-472e-af03-7a2d329a0161 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "cinder-quobyte-f911dd81-bf8c-4124-902c-c51a56d7db69" acquired by "delete_volume" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:36 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0634949-2f7b-4647-a13a-bde9541692b5]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:01:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0958deb9-8b6c-472e-af03-7a2d329a0161 tempest-TestInstancesWithCinderVolumes-2052085588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f911dd81-bf8c-4124-902c-c51a56d7db69 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:36 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f911dd81-bf8c-4124-902c-c51a56d7db69 Sep 04 16:01:36 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:37 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0958deb9-8b6c-472e-af03-7a2d329a0161 tempest-TestInstancesWithCinderVolumes-2052085588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f911dd81-bf8c-4124-902c-c51a56d7db69" returned: 0 in 0.455s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0958deb9-8b6c-472e-af03-7a2d329a0161 tempest-TestInstancesWithCinderVolumes-2052085588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f911dd81-bf8c-4124-902c-c51a56d7db69 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:37 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f911dd81-bf8c-4124-902c-c51a56d7db69 Sep 04 16:01:37 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:37 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0958deb9-8b6c-472e-af03-7a2d329a0161 tempest-TestInstancesWithCinderVolumes-2052085588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f911dd81-bf8c-4124-902c-c51a56d7db69" returned: 0 in 0.329s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:37 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0958deb9-8b6c-472e-af03-7a2d329a0161 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "cinder-quobyte-f911dd81-bf8c-4124-902c-c51a56d7db69" released by "delete_volume" :: held 0.844s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:37 devstack cinder-volume[87490]: WARNING cinder.quota [None req-0958deb9-8b6c-472e-af03-7a2d329a0161 tempest-TestInstancesWithCinderVolumes-2052085588 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1619164624-1993420192 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1619164624-1993420192, it is now deprecated. Please use the default quota class for default quota. Sep 04 16:01:37 devstack cinder-volume[87490]: WARNING cinder.quota [None req-0958deb9-8b6c-472e-af03-7a2d329a0161 tempest-TestInstancesWithCinderVolumes-2052085588 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1619164624-1993420192 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1619164624-1993420192, it is now deprecated. Please use the default quota class for default quota. Sep 04 16:01:37 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-0958deb9-8b6c-472e-af03-7a2d329a0161 tempest-TestInstancesWithCinderVolumes-2052085588 None] Created reservations ['ec622251-019a-4695-81dd-ce7f6012a15f', '5a8a5846-b925-4d92-af10-ebf2ae056874', 'd7648ff9-6060-46b2-b1ea-65880ae86fbd', '10cf6238-0f2f-4f97-bfe5-43afd9c27773'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:01:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0958deb9-8b6c-472e-af03-7a2d329a0161 tempest-TestInstancesWithCinderVolumes-2052085588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0958deb9-8b6c-472e-af03-7a2d329a0161 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:37 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-0958deb9-8b6c-472e-af03-7a2d329a0161 tempest-TestInstancesWithCinderVolumes-2052085588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:01:37 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-0958deb9-8b6c-472e-af03-7a2d329a0161 tempest-TestInstancesWithCinderVolumes-2052085588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:01:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0958deb9-8b6c-472e-af03-7a2d329a0161 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0958deb9-8b6c-472e-af03-7a2d329a0161 tempest-TestInstancesWithCinderVolumes-2052085588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:37 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:01:37 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:38 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0958deb9-8b6c-472e-af03-7a2d329a0161 tempest-TestInstancesWithCinderVolumes-2052085588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.425s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:38 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-0958deb9-8b6c-472e-af03-7a2d329a0161 tempest-TestInstancesWithCinderVolumes-2052085588 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:01:38 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-0958deb9-8b6c-472e-af03-7a2d329a0161 tempest-TestInstancesWithCinderVolumes-2052085588 None] Deleted volume successfully. Sep 04 16:01:38 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0958deb9-8b6c-472e-af03-7a2d329a0161 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "cinder-f911dd81-bf8c-4124-902c-c51a56d7db69-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:01:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:01:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:01:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:38 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:01:38 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:38 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.366s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:38 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:01:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager._thread_info {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:01:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread count: 28 {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 16:01:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread info: [<_MainThread(MainThread, started 138899118923904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 16:01:39 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:01:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Flow 'volume_create_manager' (9fb512bd-2477-4b4b-9e82-b8c954febaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:01:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17847118-7c82-42ff-bf31-73bb5dbfb6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17847118-7c82-42ff-bf31-73bb5dbfb6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-794210027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1826041-4f15-4efd-ae8d-aa650d8f8469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8919a027a1714f038ac639b936eaf812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:01:39Z,use_quota=True,user_id='4bc1381c3a314b71ac8597c2d1ffc763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713a0165-4325-41df-bee2-cdb4371ce583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713a0165-4325-41df-bee2-cdb4371ce583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b4ca25-ab4c-4f19-95db-708fe9fab959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b4ca25-ab4c-4f19-95db-708fe9fab959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1826041-4f15-4efd-ae8d-aa650d8f8469', 'volume_name': 'volume-a1826041-4f15-4efd-ae8d-aa650d8f8469', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9401f8-39d3-420f-a004-3eec11e4fd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9401f8-39d3-420f-a004-3eec11e4fd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (963404b7-458a-4869-8516-33d24847ea72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:39 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Volume a1826041-4f15-4efd-ae8d-aa650d8f8469: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1826041-4f15-4efd-ae8d-aa650d8f8469', 'volume_size': 1} Sep 04 16:01:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-794210027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1826041-4f15-4efd-ae8d-aa650d8f8469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8919a027a1714f038ac639b936eaf812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:01:39Z,use_quota=True,user_id='4bc1381c3a314b71ac8597c2d1ffc763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:01:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Creating volume a1826041-4f15-4efd-ae8d-aa650d8f8469 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:01:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:01:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:01:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:01:39 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:01:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a1826041-4f15-4efd-ae8d-aa650d8f8469 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:39 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a1826041-4f15-4efd-ae8d-aa650d8f8469 1073741824 Sep 04 16:01:39 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:40 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a1826041-4f15-4efd-ae8d-aa650d8f8469 1073741824" returned: 0 in 0.722s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a1826041-4f15-4efd-ae8d-aa650d8f8469 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:40 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a1826041-4f15-4efd-ae8d-aa650d8f8469 Sep 04 16:01:40 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:40 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a1826041-4f15-4efd-ae8d-aa650d8f8469" returned: 0 in 0.494s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:40 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:01:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (963404b7-458a-4869-8516-33d24847ea72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1826041-4f15-4efd-ae8d-aa650d8f8469', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae09200-32dd-402f-bd41-c3fe0420a88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:40 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Volume volume-a1826041-4f15-4efd-ae8d-aa650d8f8469 (a1826041-4f15-4efd-ae8d-aa650d8f8469): created successfully Sep 04 16:01:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae09200-32dd-402f-bd41-c3fe0420a88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Flow 'volume_create_manager' (9fb512bd-2477-4b4b-9e82-b8c954febaf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:01:40 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-9d695be0-10e8-4e39-b39b-7d9eefa77abb tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Created volume successfully. Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Flow 'volume_create_manager' (20000e4c-26d3-404b-9a60-081a70f21bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74043267-c53b-4b59-b28d-9a9606cee28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74043267-c53b-4b59-b28d-9a9606cee28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-191200000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309705fc-0ebd-4bce-b99e-c18f7a03c4d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8919a027a1714f038ac639b936eaf812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:01:42Z,use_quota=True,user_id='4bc1381c3a314b71ac8597c2d1ffc763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b776677-0080-40aa-9e78-7f17e52bd3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b776677-0080-40aa-9e78-7f17e52bd3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3a4445-f31e-4c4b-a29a-263c37b8aa9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3a4445-f31e-4c4b-a29a-263c37b8aa9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '309705fc-0ebd-4bce-b99e-c18f7a03c4d0', 'volume_name': 'volume-309705fc-0ebd-4bce-b99e-c18f7a03c4d0', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2240c23f-2c57-42fd-ba44-049295319b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2240c23f-2c57-42fd-ba44-049295319b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4913c58-21ca-4cd6-b3bb-5166cc88af34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:42 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Volume 309705fc-0ebd-4bce-b99e-c18f7a03c4d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-309705fc-0ebd-4bce-b99e-c18f7a03c4d0', 'volume_size': 1} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-191200000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309705fc-0ebd-4bce-b99e-c18f7a03c4d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8919a027a1714f038ac639b936eaf812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:01:42Z,use_quota=True,user_id='4bc1381c3a314b71ac8597c2d1ffc763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Creating volume 309705fc-0ebd-4bce-b99e-c18f7a03c4d0 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:01:42 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-309705fc-0ebd-4bce-b99e-c18f7a03c4d0 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:42 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-309705fc-0ebd-4bce-b99e-c18f7a03c4d0 1073741824 Sep 04 16:01:42 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Flow 'volume_create_manager' (81c2812f-8da0-4d91-9c32-4f2b0d8480d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68ef2d44-fdcb-49ca-b26b-a84def0d82f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68ef2d44-fdcb-49ca-b26b-a84def0d82f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1060586795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0dde36d-e14f-4156-8e5f-ea4eeaf2d590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8919a027a1714f038ac639b936eaf812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:01:43Z,use_quota=True,user_id='4bc1381c3a314b71ac8597c2d1ffc763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c579a678-f465-407f-8144-5b4cd757032d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c579a678-f465-407f-8144-5b4cd757032d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a391ce-2d62-4c93-bb20-999283e63b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a391ce-2d62-4c93-bb20-999283e63b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0dde36d-e14f-4156-8e5f-ea4eeaf2d590', 'volume_name': 'volume-c0dde36d-e14f-4156-8e5f-ea4eeaf2d590', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd7f3bd-6577-4ac5-9ab8-9586e009925a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd7f3bd-6577-4ac5-9ab8-9586e009925a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8f2a5a-410b-40ca-b99e-5b6f9d825838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:42 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Volume c0dde36d-e14f-4156-8e5f-ea4eeaf2d590: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0dde36d-e14f-4156-8e5f-ea4eeaf2d590', 'volume_size': 1} Sep 04 16:01:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:43 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-309705fc-0ebd-4bce-b99e-c18f7a03c4d0 1073741824" returned: 0 in 0.778s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-309705fc-0ebd-4bce-b99e-c18f7a03c4d0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:43 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-309705fc-0ebd-4bce-b99e-c18f7a03c4d0 Sep 04 16:01:43 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Flow 'volume_create_manager' (3f54157e-42f1-4a71-9f81-d3645804d92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f99f4b08-4947-4c6d-9282-61f0c1c7bfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f99f4b08-4947-4c6d-9282-61f0c1c7bfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-414823607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c9b024-8521-48a3-aaf2-968044983e93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8919a027a1714f038ac639b936eaf812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:01:43Z,use_quota=True,user_id='4bc1381c3a314b71ac8597c2d1ffc763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c7839c2-a5fd-4977-b615-df3231e8a22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c7839c2-a5fd-4977-b615-df3231e8a22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4344de-3916-4565-b7ca-fd2e0175fa94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4344de-3916-4565-b7ca-fd2e0175fa94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28c9b024-8521-48a3-aaf2-968044983e93', 'volume_name': 'volume-28c9b024-8521-48a3-aaf2-968044983e93', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da63bd2c-099d-4f4a-8abc-bf16bc01fad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:43 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da63bd2c-099d-4f4a-8abc-bf16bc01fad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (680f150d-3e95-4f81-90fd-b30af4c19b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:43 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Volume 28c9b024-8521-48a3-aaf2-968044983e93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28c9b024-8521-48a3-aaf2-968044983e93', 'volume_size': 1} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-309705fc-0ebd-4bce-b99e-c18f7a03c4d0" returned: 0 in 0.309s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.440s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1060586795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0dde36d-e14f-4156-8e5f-ea4eeaf2d590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8919a027a1714f038ac639b936eaf812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:01:43Z,use_quota=True,user_id='4bc1381c3a314b71ac8597c2d1ffc763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Creating volume c0dde36d-e14f-4156-8e5f-ea4eeaf2d590 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:01:43 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c0dde36d-e14f-4156-8e5f-ea4eeaf2d590 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:43 devstack sudo[101429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c0dde36d-e14f-4156-8e5f-ea4eeaf2d590 1073741824 Sep 04 16:01:43 devstack sudo[101429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4913c58-21ca-4cd6-b3bb-5166cc88af34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-309705fc-0ebd-4bce-b99e-c18f7a03c4d0', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf91ca7a-2ad6-4940-9520-facb96be9857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:43 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Volume volume-309705fc-0ebd-4bce-b99e-c18f7a03c4d0 (309705fc-0ebd-4bce-b99e-c18f7a03c4d0): created successfully Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf91ca7a-2ad6-4940-9520-facb96be9857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Flow 'volume_create_manager' (20000e4c-26d3-404b-9a60-081a70f21bd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:01:43 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-1e2c8f05-da27-4af3-84ea-e3c5950c639a tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Created volume successfully. Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Flow 'volume_create_manager' (e9f61041-2258-4553-9c1c-7de9ad931133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8697b028-8292-4071-9599-09c77fc7d100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8697b028-8292-4071-9599-09c77fc7d100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1048456408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=096a843d-71b1-4db4-bf8f-a313c7a57c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8919a027a1714f038ac639b936eaf812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:01:44Z,use_quota=True,user_id='4bc1381c3a314b71ac8597c2d1ffc763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10674a25-8f84-41ec-9dfe-956af0cacc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10674a25-8f84-41ec-9dfe-956af0cacc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84ad9ba-fb7f-4a1a-a3ec-f81118d2e545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84ad9ba-fb7f-4a1a-a3ec-f81118d2e545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '096a843d-71b1-4db4-bf8f-a313c7a57c6a', 'volume_name': 'volume-096a843d-71b1-4db4-bf8f-a313c7a57c6a', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27531195-13e9-4f52-8e06-62a1b647e12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27531195-13e9-4f52-8e06-62a1b647e12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa235f4c-387c-454e-8a62-73b5ad7607d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:43 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Volume 096a843d-71b1-4db4-bf8f-a313c7a57c6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-096a843d-71b1-4db4-bf8f-a313c7a57c6a', 'volume_size': 1} Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:43 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-3dfa4d44-f8a9-447d-8299-697f8fec9aab req-3a8a93f7-3f7d-4753-8b70-edda30dca888 tempest-TestInstancesWithCinderVolumes-2052085588 None] Terminate volume connection completed successfully. Sep 04 16:01:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-3dfa4d44-f8a9-447d-8299-697f8fec9aab req-3a8a93f7-3f7d-4753-8b70-edda30dca888 tempest-TestInstancesWithCinderVolumes-2052085588 None] Deleting attachment b20bad18-7303-4b4a-8c23-d8e68708fcef. {{(pid=87490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 16:01:44 devstack sudo[101429]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c0dde36d-e14f-4156-8e5f-ea4eeaf2d590 1073741824" returned: 0 in 0.843s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c0dde36d-e14f-4156-8e5f-ea4eeaf2d590 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:44 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c0dde36d-e14f-4156-8e5f-ea4eeaf2d590 Sep 04 16:01:44 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Flow 'volume_create_manager' (1a7f17b5-a721-4bee-89bc-211b9e48e80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df755c7f-d8d0-4cc0-b9f6-3a669a5944b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df755c7f-d8d0-4cc0-b9f6-3a669a5944b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-148706300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=752b5a9d-1024-4c9b-868b-049c37cf33a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8919a027a1714f038ac639b936eaf812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:01:44Z,use_quota=True,user_id='4bc1381c3a314b71ac8597c2d1ffc763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429a06fe-82f3-4f99-932e-afebeb7444b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429a06fe-82f3-4f99-932e-afebeb7444b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcafe3f1-225e-4d8b-9297-d5d40fa4f996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcafe3f1-225e-4d8b-9297-d5d40fa4f996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '752b5a9d-1024-4c9b-868b-049c37cf33a6', 'volume_name': 'volume-752b5a9d-1024-4c9b-868b-049c37cf33a6', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecda52a1-3c2f-4507-9768-582eca7ab86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecda52a1-3c2f-4507-9768-582eca7ab86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9994d60-a646-48af-b142-b30ae4481325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:44 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Volume 752b5a9d-1024-4c9b-868b-049c37cf33a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-752b5a9d-1024-4c9b-868b-049c37cf33a6', 'volume_size': 1} Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:44 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c0dde36d-e14f-4156-8e5f-ea4eeaf2d590" returned: 0 in 0.278s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.189s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-414823607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c9b024-8521-48a3-aaf2-968044983e93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8919a027a1714f038ac639b936eaf812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:01:43Z,use_quota=True,user_id='4bc1381c3a314b71ac8597c2d1ffc763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Creating volume 28c9b024-8521-48a3-aaf2-968044983e93 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:01:44 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-28c9b024-8521-48a3-aaf2-968044983e93 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8f2a5a-410b-40ca-b99e-5b6f9d825838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0dde36d-e14f-4156-8e5f-ea4eeaf2d590', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:44 devstack sudo[101439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-28c9b024-8521-48a3-aaf2-968044983e93 1073741824 Sep 04 16:01:44 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2f9791-9a50-4317-b71b-9ed5d6a7da80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:44 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Volume volume-c0dde36d-e14f-4156-8e5f-ea4eeaf2d590 (c0dde36d-e14f-4156-8e5f-ea4eeaf2d590): created successfully Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2f9791-9a50-4317-b71b-9ed5d6a7da80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Flow 'volume_create_manager' (81c2812f-8da0-4d91-9c32-4f2b0d8480d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:01:44 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-89c76008-d24f-4244-adf9-90e1ab03bea3 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Created volume successfully. Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c512693f-9365-4bd0-bbff-689a12269f66 tempest-TestInstancesWithCinderVolumes-2052085588 None] Acquiring lock "cinder-8140622d-98b7-4557-bf92-a30756c9a8e9-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:45 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-28c9b024-8521-48a3-aaf2-968044983e93 1073741824" returned: 0 in 0.498s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c512693f-9365-4bd0-bbff-689a12269f66 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "cinder-8140622d-98b7-4557-bf92-a30756c9a8e9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-28c9b024-8521-48a3-aaf2-968044983e93 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c512693f-9365-4bd0-bbff-689a12269f66 tempest-TestInstancesWithCinderVolumes-2052085588 None] Acquiring lock "cinder-quobyte-8140622d-98b7-4557-bf92-a30756c9a8e9" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:45 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-28c9b024-8521-48a3-aaf2-968044983e93 Sep 04 16:01:45 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c512693f-9365-4bd0-bbff-689a12269f66 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "cinder-quobyte-8140622d-98b7-4557-bf92-a30756c9a8e9" acquired by "delete_volume" :: waited 0.019s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cf9c35-4071-42f2-b37c-1a79783a8ef8]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c512693f-9365-4bd0-bbff-689a12269f66 tempest-TestInstancesWithCinderVolumes-2052085588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8140622d-98b7-4557-bf92-a30756c9a8e9 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:45 devstack sudo[101447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8140622d-98b7-4557-bf92-a30756c9a8e9 Sep 04 16:01:45 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:45 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-28c9b024-8521-48a3-aaf2-968044983e93" returned: 0 in 0.263s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.507s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1048456408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=096a843d-71b1-4db4-bf8f-a313c7a57c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8919a027a1714f038ac639b936eaf812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:01:44Z,use_quota=True,user_id='4bc1381c3a314b71ac8597c2d1ffc763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Creating volume 096a843d-71b1-4db4-bf8f-a313c7a57c6a {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:01:45 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-096a843d-71b1-4db4-bf8f-a313c7a57c6a 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (680f150d-3e95-4f81-90fd-b30af4c19b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28c9b024-8521-48a3-aaf2-968044983e93', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:45 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-096a843d-71b1-4db4-bf8f-a313c7a57c6a 1073741824 Sep 04 16:01:45 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a66be5-29fd-4195-ae5b-3162971537bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:45 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Volume volume-28c9b024-8521-48a3-aaf2-968044983e93 (28c9b024-8521-48a3-aaf2-968044983e93): created successfully Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a66be5-29fd-4195-ae5b-3162971537bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Flow 'volume_create_manager' (3f54157e-42f1-4a71-9f81-d3645804d92e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:01:45 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-a811403e-3a30-4722-962c-3f5624067178 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Created volume successfully. Sep 04 16:01:45 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c512693f-9365-4bd0-bbff-689a12269f66 tempest-TestInstancesWithCinderVolumes-2052085588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8140622d-98b7-4557-bf92-a30756c9a8e9" returned: 0 in 0.399s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c512693f-9365-4bd0-bbff-689a12269f66 tempest-TestInstancesWithCinderVolumes-2052085588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8140622d-98b7-4557-bf92-a30756c9a8e9 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:45 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8140622d-98b7-4557-bf92-a30756c9a8e9 Sep 04 16:01:45 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:45 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:45 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c512693f-9365-4bd0-bbff-689a12269f66 tempest-TestInstancesWithCinderVolumes-2052085588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8140622d-98b7-4557-bf92-a30756c9a8e9" returned: 0 in 0.257s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-096a843d-71b1-4db4-bf8f-a313c7a57c6a 1073741824" returned: 0 in 0.448s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c512693f-9365-4bd0-bbff-689a12269f66 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "cinder-quobyte-8140622d-98b7-4557-bf92-a30756c9a8e9" released by "delete_volume" :: held 0.707s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-096a843d-71b1-4db4-bf8f-a313c7a57c6a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:45 devstack cinder-volume[87490]: WARNING cinder.quota [None req-c512693f-9365-4bd0-bbff-689a12269f66 tempest-TestInstancesWithCinderVolumes-2052085588 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1285956297-275522187 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1285956297-275522187, it is now deprecated. Please use the default quota class for default quota. Sep 04 16:01:45 devstack cinder-volume[87490]: WARNING cinder.quota [None req-c512693f-9365-4bd0-bbff-689a12269f66 tempest-TestInstancesWithCinderVolumes-2052085588 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1285956297-275522187 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1285956297-275522187, it is now deprecated. Please use the default quota class for default quota. Sep 04 16:01:46 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-096a843d-71b1-4db4-bf8f-a313c7a57c6a Sep 04 16:01:46 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-c512693f-9365-4bd0-bbff-689a12269f66 tempest-TestInstancesWithCinderVolumes-2052085588 None] Created reservations ['9ad8b575-9278-4ccf-bc95-de36e62866dc', '6a0a3429-1358-4c78-800c-f8008f8cb35b', '36da0409-00fe-462a-b5d7-2c7f781395bf', '9b8224c4-9a9e-43e4-b3d0-d016b0f60973'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c512693f-9365-4bd0-bbff-689a12269f66 tempest-TestInstancesWithCinderVolumes-2052085588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c512693f-9365-4bd0-bbff-689a12269f66 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c512693f-9365-4bd0-bbff-689a12269f66 tempest-TestInstancesWithCinderVolumes-2052085588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c512693f-9365-4bd0-bbff-689a12269f66 tempest-TestInstancesWithCinderVolumes-2052085588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c512693f-9365-4bd0-bbff-689a12269f66 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c512693f-9365-4bd0-bbff-689a12269f66 tempest-TestInstancesWithCinderVolumes-2052085588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:46 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:01:46 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:46 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-096a843d-71b1-4db4-bf8f-a313c7a57c6a" returned: 0 in 0.292s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.754s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-148706300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=752b5a9d-1024-4c9b-868b-049c37cf33a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8919a027a1714f038ac639b936eaf812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:01:44Z,use_quota=True,user_id='4bc1381c3a314b71ac8597c2d1ffc763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Creating volume 752b5a9d-1024-4c9b-868b-049c37cf33a6 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:01:46 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-752b5a9d-1024-4c9b-868b-049c37cf33a6 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa235f4c-387c-454e-8a62-73b5ad7607d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-096a843d-71b1-4db4-bf8f-a313c7a57c6a', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3109e0d-737b-4d9a-bf21-6bb7a71b24e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:46 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-752b5a9d-1024-4c9b-868b-049c37cf33a6 1073741824 Sep 04 16:01:46 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:46 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Volume volume-096a843d-71b1-4db4-bf8f-a313c7a57c6a (096a843d-71b1-4db4-bf8f-a313c7a57c6a): created successfully Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3109e0d-737b-4d9a-bf21-6bb7a71b24e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Flow 'volume_create_manager' (e9f61041-2258-4553-9c1c-7de9ad931133) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:01:46 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-be2f9ed4-b91b-4d11-a1cc-7571533fa5a4 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Created volume successfully. Sep 04 16:01:46 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c512693f-9365-4bd0-bbff-689a12269f66 tempest-TestInstancesWithCinderVolumes-2052085588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.267s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-c512693f-9365-4bd0-bbff-689a12269f66 tempest-TestInstancesWithCinderVolumes-2052085588 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:01:46 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-c512693f-9365-4bd0-bbff-689a12269f66 tempest-TestInstancesWithCinderVolumes-2052085588 None] Deleted volume successfully. Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c512693f-9365-4bd0-bbff-689a12269f66 tempest-TestInstancesWithCinderVolumes-2052085588 None] Lock "cinder-8140622d-98b7-4557-bf92-a30756c9a8e9-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:46 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-752b5a9d-1024-4c9b-868b-049c37cf33a6 1073741824" returned: 0 in 0.567s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-752b5a9d-1024-4c9b-868b-049c37cf33a6 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:46 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-752b5a9d-1024-4c9b-868b-049c37cf33a6 Sep 04 16:01:46 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:47 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-752b5a9d-1024-4c9b-868b-049c37cf33a6" returned: 0 in 0.303s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:47 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:01:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9994d60-a646-48af-b142-b30ae4481325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-752b5a9d-1024-4c9b-868b-049c37cf33a6', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe974c05-f6d7-48bb-b65d-0364086cb8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:01:47 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Volume volume-752b5a9d-1024-4c9b-868b-049c37cf33a6 (752b5a9d-1024-4c9b-868b-049c37cf33a6): created successfully Sep 04 16:01:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe974c05-f6d7-48bb-b65d-0364086cb8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:01:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Flow 'volume_create_manager' (1a7f17b5-a721-4bee-89bc-211b9e48e80f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:01:47 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-b738f8f3-a9f7-45ca-a744-ccaa52868d0c tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Created volume successfully. Sep 04 16:01:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7808b88a-ac7c-4c9a-a6c7-ff65257d891b tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "cinder-752b5a9d-1024-4c9b-868b-049c37cf33a6-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7808b88a-ac7c-4c9a-a6c7-ff65257d891b tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "cinder-752b5a9d-1024-4c9b-868b-049c37cf33a6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7808b88a-ac7c-4c9a-a6c7-ff65257d891b tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "cinder-quobyte-752b5a9d-1024-4c9b-868b-049c37cf33a6" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7808b88a-ac7c-4c9a-a6c7-ff65257d891b tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "cinder-quobyte-752b5a9d-1024-4c9b-868b-049c37cf33a6" acquired by "delete_volume" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:47 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c329d5-9368-4b30-ac6c-f66bdb0fae8b]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:01:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7808b88a-ac7c-4c9a-a6c7-ff65257d891b tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-752b5a9d-1024-4c9b-868b-049c37cf33a6 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:48 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-752b5a9d-1024-4c9b-868b-049c37cf33a6 Sep 04 16:01:48 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:48 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7808b88a-ac7c-4c9a-a6c7-ff65257d891b tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-752b5a9d-1024-4c9b-868b-049c37cf33a6" returned: 0 in 0.434s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7808b88a-ac7c-4c9a-a6c7-ff65257d891b tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-752b5a9d-1024-4c9b-868b-049c37cf33a6 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:48 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-752b5a9d-1024-4c9b-868b-049c37cf33a6 Sep 04 16:01:48 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:48 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7808b88a-ac7c-4c9a-a6c7-ff65257d891b tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-752b5a9d-1024-4c9b-868b-049c37cf33a6" returned: 0 in 0.277s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:48 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7808b88a-ac7c-4c9a-a6c7-ff65257d891b tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "cinder-quobyte-752b5a9d-1024-4c9b-868b-049c37cf33a6" released by "delete_volume" :: held 0.755s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:48 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-7808b88a-ac7c-4c9a-a6c7-ff65257d891b tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Created reservations ['e4c1dd10-7f36-4f2b-8298-646f3fd1031c', 'fd8a6bd3-2d3d-4d12-960b-576a0afb6b4f', '1bde9163-5efa-4ded-99d4-4de674ed9ba7', '1505f0b3-42f7-4aa5-b344-9ef558fa4be8'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:01:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7808b88a-ac7c-4c9a-a6c7-ff65257d891b tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7808b88a-ac7c-4c9a-a6c7-ff65257d891b tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7808b88a-ac7c-4c9a-a6c7-ff65257d891b tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:01:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7808b88a-ac7c-4c9a-a6c7-ff65257d891b tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:01:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7808b88a-ac7c-4c9a-a6c7-ff65257d891b tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7808b88a-ac7c-4c9a-a6c7-ff65257d891b tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:48 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:01:48 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b6b6afed-52d6-4ccf-90d0-520abc3a12fa tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "cinder-096a843d-71b1-4db4-bf8f-a313c7a57c6a-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b6b6afed-52d6-4ccf-90d0-520abc3a12fa tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "cinder-096a843d-71b1-4db4-bf8f-a313c7a57c6a-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b6b6afed-52d6-4ccf-90d0-520abc3a12fa tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "cinder-quobyte-096a843d-71b1-4db4-bf8f-a313c7a57c6a" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b6b6afed-52d6-4ccf-90d0-520abc3a12fa tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "cinder-quobyte-096a843d-71b1-4db4-bf8f-a313c7a57c6a" acquired by "delete_volume" :: waited 0.020s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:49 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7808b88a-ac7c-4c9a-a6c7-ff65257d891b tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.349s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:49 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-7808b88a-ac7c-4c9a-a6c7-ff65257d891b tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:01:49 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-7808b88a-ac7c-4c9a-a6c7-ff65257d891b tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Deleted volume successfully. Sep 04 16:01:49 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5588c8-0fa6-45e2-a3a8-3a4270a2d973]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:01:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b6b6afed-52d6-4ccf-90d0-520abc3a12fa tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-096a843d-71b1-4db4-bf8f-a313c7a57c6a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7808b88a-ac7c-4c9a-a6c7-ff65257d891b tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "cinder-752b5a9d-1024-4c9b-868b-049c37cf33a6-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:49 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-096a843d-71b1-4db4-bf8f-a313c7a57c6a Sep 04 16:01:49 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:49 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b6b6afed-52d6-4ccf-90d0-520abc3a12fa tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-096a843d-71b1-4db4-bf8f-a313c7a57c6a" returned: 0 in 0.471s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b6b6afed-52d6-4ccf-90d0-520abc3a12fa tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-096a843d-71b1-4db4-bf8f-a313c7a57c6a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:49 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-096a843d-71b1-4db4-bf8f-a313c7a57c6a Sep 04 16:01:49 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:49 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b6b6afed-52d6-4ccf-90d0-520abc3a12fa tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-096a843d-71b1-4db4-bf8f-a313c7a57c6a" returned: 0 in 0.324s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:50 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b6b6afed-52d6-4ccf-90d0-520abc3a12fa tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "cinder-quobyte-096a843d-71b1-4db4-bf8f-a313c7a57c6a" released by "delete_volume" :: held 0.868s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:50 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-b6b6afed-52d6-4ccf-90d0-520abc3a12fa tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Created reservations ['ea72b23a-9cea-4bb9-a47b-54a1f39f57d2', '2233d069-e912-492e-8058-cf21aeb7c740', '62663243-0827-415c-82af-924064c35fa6', 'f718e7c7-1b68-40e8-bac3-0fa087707887'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:01:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b6b6afed-52d6-4ccf-90d0-520abc3a12fa tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b6b6afed-52d6-4ccf-90d0-520abc3a12fa tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b6b6afed-52d6-4ccf-90d0-520abc3a12fa tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:01:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b6b6afed-52d6-4ccf-90d0-520abc3a12fa tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:01:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b6b6afed-52d6-4ccf-90d0-520abc3a12fa tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b6b6afed-52d6-4ccf-90d0-520abc3a12fa tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:50 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:01:50 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:50 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-93504b85-82ec-4064-adb0-a715a1a07ca9 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "cinder-28c9b024-8521-48a3-aaf2-968044983e93-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:50 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-93504b85-82ec-4064-adb0-a715a1a07ca9 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "cinder-28c9b024-8521-48a3-aaf2-968044983e93-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:50 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-93504b85-82ec-4064-adb0-a715a1a07ca9 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "cinder-quobyte-28c9b024-8521-48a3-aaf2-968044983e93" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:50 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-93504b85-82ec-4064-adb0-a715a1a07ca9 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "cinder-quobyte-28c9b024-8521-48a3-aaf2-968044983e93" acquired by "delete_volume" :: waited 0.019s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:50 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f12d4e-359e-452a-97df-80642969bbe2]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:01:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-93504b85-82ec-4064-adb0-a715a1a07ca9 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-28c9b024-8521-48a3-aaf2-968044983e93 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:50 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:50 devstack sudo[101506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-28c9b024-8521-48a3-aaf2-968044983e93 Sep 04 16:01:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b6b6afed-52d6-4ccf-90d0-520abc3a12fa tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.295s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:50 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-b6b6afed-52d6-4ccf-90d0-520abc3a12fa tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:01:50 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:50 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-b6b6afed-52d6-4ccf-90d0-520abc3a12fa tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Deleted volume successfully. Sep 04 16:01:50 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b6b6afed-52d6-4ccf-90d0-520abc3a12fa tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "cinder-096a843d-71b1-4db4-bf8f-a313c7a57c6a-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:50 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-93504b85-82ec-4064-adb0-a715a1a07ca9 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-28c9b024-8521-48a3-aaf2-968044983e93" returned: 0 in 0.429s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-93504b85-82ec-4064-adb0-a715a1a07ca9 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-28c9b024-8521-48a3-aaf2-968044983e93 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:50 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-28c9b024-8521-48a3-aaf2-968044983e93 Sep 04 16:01:50 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:51 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-93504b85-82ec-4064-adb0-a715a1a07ca9 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-28c9b024-8521-48a3-aaf2-968044983e93" returned: 0 in 0.314s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:51 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-93504b85-82ec-4064-adb0-a715a1a07ca9 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "cinder-quobyte-28c9b024-8521-48a3-aaf2-968044983e93" released by "delete_volume" :: held 0.789s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:51 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-93504b85-82ec-4064-adb0-a715a1a07ca9 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Created reservations ['3f649dd6-21bc-4cef-9ac2-3319d22bacb5', '9dff6186-418e-4312-b78c-c8d0c6deeeb6', 'd0f2fb4c-fad5-4bfc-942a-2d7c2d9d7223', '91f35579-aa01-4cc1-a3ec-2279f0fd9888'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:01:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-93504b85-82ec-4064-adb0-a715a1a07ca9 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-93504b85-82ec-4064-adb0-a715a1a07ca9 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:51 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-93504b85-82ec-4064-adb0-a715a1a07ca9 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:01:51 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-93504b85-82ec-4064-adb0-a715a1a07ca9 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:01:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-93504b85-82ec-4064-adb0-a715a1a07ca9 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-93504b85-82ec-4064-adb0-a715a1a07ca9 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:51 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:01:51 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:51 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0f6a8828-c65f-4b0f-90ee-a15366c4d11f tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "cinder-c0dde36d-e14f-4156-8e5f-ea4eeaf2d590-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:51 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0f6a8828-c65f-4b0f-90ee-a15366c4d11f tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "cinder-c0dde36d-e14f-4156-8e5f-ea4eeaf2d590-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:51 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0f6a8828-c65f-4b0f-90ee-a15366c4d11f tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "cinder-quobyte-c0dde36d-e14f-4156-8e5f-ea4eeaf2d590" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:51 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0f6a8828-c65f-4b0f-90ee-a15366c4d11f tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "cinder-quobyte-c0dde36d-e14f-4156-8e5f-ea4eeaf2d590" acquired by "delete_volume" :: waited 0.019s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:51 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1a39e7-8c4b-4811-af8c-4aaac2c3c380]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:01:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0f6a8828-c65f-4b0f-90ee-a15366c4d11f tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c0dde36d-e14f-4156-8e5f-ea4eeaf2d590 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:51 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-93504b85-82ec-4064-adb0-a715a1a07ca9 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.318s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:51 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-93504b85-82ec-4064-adb0-a715a1a07ca9 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:01:51 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-93504b85-82ec-4064-adb0-a715a1a07ca9 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Deleted volume successfully. Sep 04 16:01:51 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-93504b85-82ec-4064-adb0-a715a1a07ca9 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "cinder-28c9b024-8521-48a3-aaf2-968044983e93-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:51 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c0dde36d-e14f-4156-8e5f-ea4eeaf2d590 Sep 04 16:01:51 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:51 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0f6a8828-c65f-4b0f-90ee-a15366c4d11f tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c0dde36d-e14f-4156-8e5f-ea4eeaf2d590" returned: 0 in 0.415s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0f6a8828-c65f-4b0f-90ee-a15366c4d11f tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c0dde36d-e14f-4156-8e5f-ea4eeaf2d590 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:51 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c0dde36d-e14f-4156-8e5f-ea4eeaf2d590 Sep 04 16:01:51 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:52 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0f6a8828-c65f-4b0f-90ee-a15366c4d11f tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c0dde36d-e14f-4156-8e5f-ea4eeaf2d590" returned: 0 in 0.349s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0f6a8828-c65f-4b0f-90ee-a15366c4d11f tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "cinder-quobyte-c0dde36d-e14f-4156-8e5f-ea4eeaf2d590" released by "delete_volume" :: held 0.814s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:52 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-0f6a8828-c65f-4b0f-90ee-a15366c4d11f tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Created reservations ['49b20322-2aa8-4811-a3cd-00d48c8dd40e', '349381d3-ce2a-420d-a274-fd1a6543dee7', '0c21bbcd-1247-47a1-89be-0391d4174bd3', '720bacc6-eff0-4c16-ba11-e4503e75bad5'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:01:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0f6a8828-c65f-4b0f-90ee-a15366c4d11f tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0f6a8828-c65f-4b0f-90ee-a15366c4d11f tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:52 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-0f6a8828-c65f-4b0f-90ee-a15366c4d11f tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:01:52 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-0f6a8828-c65f-4b0f-90ee-a15366c4d11f tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:01:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0f6a8828-c65f-4b0f-90ee-a15366c4d11f tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0f6a8828-c65f-4b0f-90ee-a15366c4d11f tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:52 devstack sudo[101528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:01:52 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-37c0f910-5dda-462b-8234-9ba68a170395 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "cinder-309705fc-0ebd-4bce-b99e-c18f7a03c4d0-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-37c0f910-5dda-462b-8234-9ba68a170395 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "cinder-309705fc-0ebd-4bce-b99e-c18f7a03c4d0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-37c0f910-5dda-462b-8234-9ba68a170395 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "cinder-quobyte-309705fc-0ebd-4bce-b99e-c18f7a03c4d0" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-37c0f910-5dda-462b-8234-9ba68a170395 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "cinder-quobyte-309705fc-0ebd-4bce-b99e-c18f7a03c4d0" acquired by "delete_volume" :: waited 0.015s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:52 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4fac64-71ed-4725-907a-ece144d51e7c]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:01:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-37c0f910-5dda-462b-8234-9ba68a170395 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-309705fc-0ebd-4bce-b99e-c18f7a03c4d0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:52 devstack sudo[101530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-309705fc-0ebd-4bce-b99e-c18f7a03c4d0 Sep 04 16:01:52 devstack sudo[101530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:52 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0f6a8828-c65f-4b0f-90ee-a15366c4d11f tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.319s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:52 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-0f6a8828-c65f-4b0f-90ee-a15366c4d11f tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:01:52 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-0f6a8828-c65f-4b0f-90ee-a15366c4d11f tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Deleted volume successfully. Sep 04 16:01:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0f6a8828-c65f-4b0f-90ee-a15366c4d11f tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "cinder-c0dde36d-e14f-4156-8e5f-ea4eeaf2d590-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:53 devstack sudo[101530]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-37c0f910-5dda-462b-8234-9ba68a170395 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-309705fc-0ebd-4bce-b99e-c18f7a03c4d0" returned: 0 in 0.423s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-37c0f910-5dda-462b-8234-9ba68a170395 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-309705fc-0ebd-4bce-b99e-c18f7a03c4d0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:53 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-309705fc-0ebd-4bce-b99e-c18f7a03c4d0 Sep 04 16:01:53 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:53 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-37c0f910-5dda-462b-8234-9ba68a170395 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-309705fc-0ebd-4bce-b99e-c18f7a03c4d0" returned: 0 in 0.268s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-37c0f910-5dda-462b-8234-9ba68a170395 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "cinder-quobyte-309705fc-0ebd-4bce-b99e-c18f7a03c4d0" released by "delete_volume" :: held 0.737s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:53 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-37c0f910-5dda-462b-8234-9ba68a170395 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Created reservations ['0fe32f98-5cba-4129-bf1c-54b3e3b4ea0e', 'bfddc889-8ada-4caa-b889-d65fc7dc9dc7', 'aaeef800-4131-4804-97d8-5a05a44e7d09', '234ff6d4-4817-4009-9f33-fe9fef1a45d1'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:01:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-37c0f910-5dda-462b-8234-9ba68a170395 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-37c0f910-5dda-462b-8234-9ba68a170395 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-37c0f910-5dda-462b-8234-9ba68a170395 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:01:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-37c0f910-5dda-462b-8234-9ba68a170395 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:01:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-37c0f910-5dda-462b-8234-9ba68a170395 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-37c0f910-5dda-462b-8234-9ba68a170395 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:53 devstack sudo[101539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:01:53 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-626b2dfe-82cc-4ec6-b034-9a68b89532d0 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "cinder-a1826041-4f15-4efd-ae8d-aa650d8f8469-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-626b2dfe-82cc-4ec6-b034-9a68b89532d0 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "cinder-a1826041-4f15-4efd-ae8d-aa650d8f8469-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:53 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-37c0f910-5dda-462b-8234-9ba68a170395 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.283s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:53 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-37c0f910-5dda-462b-8234-9ba68a170395 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:01:53 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-37c0f910-5dda-462b-8234-9ba68a170395 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Deleted volume successfully. Sep 04 16:01:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-37c0f910-5dda-462b-8234-9ba68a170395 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "cinder-309705fc-0ebd-4bce-b99e-c18f7a03c4d0-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-626b2dfe-82cc-4ec6-b034-9a68b89532d0 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "cinder-quobyte-a1826041-4f15-4efd-ae8d-aa650d8f8469" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:01:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-626b2dfe-82cc-4ec6-b034-9a68b89532d0 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "cinder-quobyte-a1826041-4f15-4efd-ae8d-aa650d8f8469" acquired by "delete_volume" :: waited 0.015s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:01:53 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a739d9c-81e7-4685-b040-8ab1a078ea2b]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:01:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-626b2dfe-82cc-4ec6-b034-9a68b89532d0 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a1826041-4f15-4efd-ae8d-aa650d8f8469 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:54 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a1826041-4f15-4efd-ae8d-aa650d8f8469 Sep 04 16:01:54 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:54 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-626b2dfe-82cc-4ec6-b034-9a68b89532d0 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a1826041-4f15-4efd-ae8d-aa650d8f8469" returned: 0 in 0.396s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-626b2dfe-82cc-4ec6-b034-9a68b89532d0 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a1826041-4f15-4efd-ae8d-aa650d8f8469 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:54 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a1826041-4f15-4efd-ae8d-aa650d8f8469 Sep 04 16:01:54 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:54 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-626b2dfe-82cc-4ec6-b034-9a68b89532d0 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a1826041-4f15-4efd-ae8d-aa650d8f8469" returned: 0 in 0.309s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-626b2dfe-82cc-4ec6-b034-9a68b89532d0 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "cinder-quobyte-a1826041-4f15-4efd-ae8d-aa650d8f8469" released by "delete_volume" :: held 0.743s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:01:54 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-626b2dfe-82cc-4ec6-b034-9a68b89532d0 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Created reservations ['a3a88a03-5277-4526-bdd7-b04574707e10', 'e88e4dd9-c862-484b-bc71-a0c8aa591dc4', 'a8e3b8c7-cbbb-437b-999e-a24e5175c26a', '0ad8c7cc-44ed-4c04-81f8-734e2784a877'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:01:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-626b2dfe-82cc-4ec6-b034-9a68b89532d0 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:01:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-626b2dfe-82cc-4ec6-b034-9a68b89532d0 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:01:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-626b2dfe-82cc-4ec6-b034-9a68b89532d0 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:01:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-626b2dfe-82cc-4ec6-b034-9a68b89532d0 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:01:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-626b2dfe-82cc-4ec6-b034-9a68b89532d0 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:01:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-626b2dfe-82cc-4ec6-b034-9a68b89532d0 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:01:54 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:01:54 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:01:55 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Sep 04 16:01:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-626b2dfe-82cc-4ec6-b034-9a68b89532d0 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.299s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:01:55 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-626b2dfe-82cc-4ec6-b034-9a68b89532d0 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:01:55 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-626b2dfe-82cc-4ec6-b034-9a68b89532d0 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Deleted volume successfully. Sep 04 16:01:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-626b2dfe-82cc-4ec6-b034-9a68b89532d0 tempest-CreateVolumesFromSourceVolumeTest-556282052 None] Lock "cinder-a1826041-4f15-4efd-ae8d-aa650d8f8469-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:02:04 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=85,cinder:UPDATE=108,cinder:INSERT=22,cinder:DELETE=11 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:02:05 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=84,cinder:UPDATE=99,cinder:INSERT=24,cinder:DELETE=5 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:02:06 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-8f7ce45a-474f-4fc5-a52e-b242da2cff9f req-e8ab2a72-a24a-444a-96c9-bda17a93b833 tempest-TestShelveInstance-313521521 None] Terminate volume connection completed successfully. Sep 04 16:02:06 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-8f7ce45a-474f-4fc5-a52e-b242da2cff9f req-e8ab2a72-a24a-444a-96c9-bda17a93b833 tempest-TestShelveInstance-313521521 None] Deleting attachment 9ec0cbdd-9448-4d20-a17a-63bc16899a57. {{(pid=87490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 16:02:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-8f7ce45a-474f-4fc5-a52e-b242da2cff9f req-53bd0b02-8453-410e-9d9e-405b031cf164 tempest-TestShelveInstance-313521521 None] Acquiring lock "cinder-e7905871-ed5e-4b14-aa67-5b87b622217d-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:02:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-8f7ce45a-474f-4fc5-a52e-b242da2cff9f req-53bd0b02-8453-410e-9d9e-405b031cf164 tempest-TestShelveInstance-313521521 None] Lock "cinder-e7905871-ed5e-4b14-aa67-5b87b622217d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:02:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-8f7ce45a-474f-4fc5-a52e-b242da2cff9f req-53bd0b02-8453-410e-9d9e-405b031cf164 tempest-TestShelveInstance-313521521 None] Acquiring lock "cinder-quobyte-e7905871-ed5e-4b14-aa67-5b87b622217d" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:02:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-8f7ce45a-474f-4fc5-a52e-b242da2cff9f req-53bd0b02-8453-410e-9d9e-405b031cf164 tempest-TestShelveInstance-313521521 None] Lock "cinder-quobyte-e7905871-ed5e-4b14-aa67-5b87b622217d" acquired by "delete_volume" :: waited 0.025s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:02:06 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d219cce-b573-4ba8-bd97-78369c92f259]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:02:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-8f7ce45a-474f-4fc5-a52e-b242da2cff9f req-53bd0b02-8453-410e-9d9e-405b031cf164 tempest-TestShelveInstance-313521521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e7905871-ed5e-4b14-aa67-5b87b622217d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:06 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e7905871-ed5e-4b14-aa67-5b87b622217d Sep 04 16:02:06 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:07 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-8f7ce45a-474f-4fc5-a52e-b242da2cff9f req-53bd0b02-8453-410e-9d9e-405b031cf164 tempest-TestShelveInstance-313521521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e7905871-ed5e-4b14-aa67-5b87b622217d" returned: 0 in 0.455s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-8f7ce45a-474f-4fc5-a52e-b242da2cff9f req-53bd0b02-8453-410e-9d9e-405b031cf164 tempest-TestShelveInstance-313521521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e7905871-ed5e-4b14-aa67-5b87b622217d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:07 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e7905871-ed5e-4b14-aa67-5b87b622217d Sep 04 16:02:07 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:07 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-8f7ce45a-474f-4fc5-a52e-b242da2cff9f req-53bd0b02-8453-410e-9d9e-405b031cf164 tempest-TestShelveInstance-313521521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e7905871-ed5e-4b14-aa67-5b87b622217d" returned: 0 in 0.256s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-8f7ce45a-474f-4fc5-a52e-b242da2cff9f req-53bd0b02-8453-410e-9d9e-405b031cf164 tempest-TestShelveInstance-313521521 None] Lock "cinder-quobyte-e7905871-ed5e-4b14-aa67-5b87b622217d" released by "delete_volume" :: held 0.776s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:02:07 devstack cinder-volume[87490]: DEBUG cinder.quota [req-8f7ce45a-474f-4fc5-a52e-b242da2cff9f req-53bd0b02-8453-410e-9d9e-405b031cf164 tempest-TestShelveInstance-313521521 None] Created reservations ['f58b7fb9-1685-40fb-9098-61290bcf86a3', 'de0b9788-12ac-48f5-9063-92ce1b047bde', '5ae6bc5d-ec47-4378-85f4-2e5c0ba118cd', '22842122-ef42-468f-9a65-df12e9e05dd6'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:02:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-8f7ce45a-474f-4fc5-a52e-b242da2cff9f req-53bd0b02-8453-410e-9d9e-405b031cf164 tempest-TestShelveInstance-313521521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-8f7ce45a-474f-4fc5-a52e-b242da2cff9f req-53bd0b02-8453-410e-9d9e-405b031cf164 tempest-TestShelveInstance-313521521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:07 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [req-8f7ce45a-474f-4fc5-a52e-b242da2cff9f req-53bd0b02-8453-410e-9d9e-405b031cf164 tempest-TestShelveInstance-313521521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:02:07 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [req-8f7ce45a-474f-4fc5-a52e-b242da2cff9f req-53bd0b02-8453-410e-9d9e-405b031cf164 tempest-TestShelveInstance-313521521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:02:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-8f7ce45a-474f-4fc5-a52e-b242da2cff9f req-53bd0b02-8453-410e-9d9e-405b031cf164 tempest-TestShelveInstance-313521521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-8f7ce45a-474f-4fc5-a52e-b242da2cff9f req-53bd0b02-8453-410e-9d9e-405b031cf164 tempest-TestShelveInstance-313521521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:07 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:02:07 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:08 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [req-8f7ce45a-474f-4fc5-a52e-b242da2cff9f req-53bd0b02-8453-410e-9d9e-405b031cf164 tempest-TestShelveInstance-313521521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.342s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:08 devstack cinder-volume[87490]: DEBUG cinder.manager [req-8f7ce45a-474f-4fc5-a52e-b242da2cff9f req-53bd0b02-8453-410e-9d9e-405b031cf164 tempest-TestShelveInstance-313521521 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:02:08 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-8f7ce45a-474f-4fc5-a52e-b242da2cff9f req-53bd0b02-8453-410e-9d9e-405b031cf164 tempest-TestShelveInstance-313521521 None] Deleted volume successfully. Sep 04 16:02:08 devstack cinder-volume[87490]: DEBUG cinder.coordination [req-8f7ce45a-474f-4fc5-a52e-b242da2cff9f req-53bd0b02-8453-410e-9d9e-405b031cf164 tempest-TestShelveInstance-313521521 None] Lock "cinder-e7905871-ed5e-4b14-aa67-5b87b622217d-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:02:17 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=10 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:02:18 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=5,cinder:UPDATE=6,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:02:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager._thread_info {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:02:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread count: 28 {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 16:02:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread info: [<_MainThread(MainThread, started 138899118923904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 16:02:48 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:02:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Flow 'volume_create_manager' (927039e5-371f-44da-95a6-b5c683de00be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:02:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14a67907-b80a-4434-96df-004233fe517a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14a67907-b80a-4434-96df-004233fe517a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-589974586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1810f3bb-0127-4d04-8847-0f08c8e9d58a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e52d1924b27940b88004ec3499c87d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:48Z,use_quota=True,user_id='18f1746c6a164e908809d910b31da55b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8c14f6-b7b1-4edd-9568-274e39b0c934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8c14f6-b7b1-4edd-9568-274e39b0c934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd489a7-4526-424a-acef-699805cdd9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd489a7-4526-424a-acef-699805cdd9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1810f3bb-0127-4d04-8847-0f08c8e9d58a', 'volume_name': 'volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e09c81f-4a3d-4202-9692-41a8361666de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e09c81f-4a3d-4202-9692-41a8361666de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a84f20a-77b6-4d7f-91cd-deff7a2b16c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:48 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Volume 1810f3bb-0127-4d04-8847-0f08c8e9d58a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a', 'volume_size': 1} Sep 04 16:02:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-589974586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1810f3bb-0127-4d04-8847-0f08c8e9d58a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e52d1924b27940b88004ec3499c87d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:02:48Z,use_quota=True,user_id='18f1746c6a164e908809d910b31da55b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:02:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Creating volume 1810f3bb-0127-4d04-8847-0f08c8e9d58a {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:02:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:02:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:02:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:02:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:02:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:02:48 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:02:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:48 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a 1073741824 Sep 04 16:02:48 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:48 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a 1073741824" returned: 0 in 0.519s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:02:49 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a Sep 04 16:02:49 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:02:49 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Sep 04 16:02:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a" returned: 0 in 0.282s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:02:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:02:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:02:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a84f20a-77b6-4d7f-91cd-deff7a2b16c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71080787-85fc-4328-828b-c83051fd27cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:02:49 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Volume volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a (1810f3bb-0127-4d04-8847-0f08c8e9d58a): created successfully Sep 04 16:02:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71080787-85fc-4328-828b-c83051fd27cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:02:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Flow 'volume_create_manager' (927039e5-371f-44da-95a6-b5c683de00be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:02:49 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-44d25d6f-6330-4903-868e-b188ec5cac95 tempest-TestStampPattern-560595389 None] Created volume successfully. Sep 04 16:02:59 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:02:59 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:DELETE=1 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:03:00 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:03:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Flow 'volume_create_manager' (8903103f-0421-45dd-ae57-233d23dd0cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:03:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1153d9e-6104-4253-afe4-700e0669a910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1153d9e-6104-4253-afe4-700e0669a910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1397387271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5517fc88-3603-4baf-a39e-270f94c7ce37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52164519d47144d3b6cb8379b954cc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:03:00Z,use_quota=True,user_id='bfd4a5aa8d744eaba97c3f313e332964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8d72fc-d149-4425-88de-d7af60811d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8d72fc-d149-4425-88de-d7af60811d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ffcf2a-1f45-433a-86a1-c5810a0ba918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ffcf2a-1f45-433a-86a1-c5810a0ba918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5517fc88-3603-4baf-a39e-270f94c7ce37', 'volume_name': 'volume-5517fc88-3603-4baf-a39e-270f94c7ce37', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2748adcd-bba7-44a3-8c28-76646fd31f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2748adcd-bba7-44a3-8c28-76646fd31f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:00 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e3a5eb-33e5-4658-b217-b73a2fb07b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:00 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Volume 5517fc88-3603-4baf-a39e-270f94c7ce37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5517fc88-3603-4baf-a39e-270f94c7ce37', 'volume_size': 1} Sep 04 16:03:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:03:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:03:00 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1397387271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5517fc88-3603-4baf-a39e-270f94c7ce37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52164519d47144d3b6cb8379b954cc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:03:00Z,use_quota=True,user_id='bfd4a5aa8d744eaba97c3f313e332964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:03:00 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Creating volume 5517fc88-3603-4baf-a39e-270f94c7ce37 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:03:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:03:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:03:00 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:03:00 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:03:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:03:00 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:03:00 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:03:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5517fc88-3603-4baf-a39e-270f94c7ce37 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:00 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5517fc88-3603-4baf-a39e-270f94c7ce37 1073741824 Sep 04 16:03:00 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:00 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5517fc88-3603-4baf-a39e-270f94c7ce37 1073741824" returned: 0 in 0.396s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5517fc88-3603-4baf-a39e-270f94c7ce37 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:00 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5517fc88-3603-4baf-a39e-270f94c7ce37 Sep 04 16:03:00 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:01 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5517fc88-3603-4baf-a39e-270f94c7ce37" returned: 0 in 0.247s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:01 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:03:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:03:01 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e3a5eb-33e5-4658-b217-b73a2fb07b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5517fc88-3603-4baf-a39e-270f94c7ce37', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:01 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c961d68-362f-449f-a622-beeae8702499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:01 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Volume volume-5517fc88-3603-4baf-a39e-270f94c7ce37 (5517fc88-3603-4baf-a39e-270f94c7ce37): created successfully Sep 04 16:03:01 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c961d68-362f-449f-a622-beeae8702499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:01 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Flow 'volume_create_manager' (8903103f-0421-45dd-ae57-233d23dd0cfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:03:01 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-7b7316ed-9cf3-4364-a0c8-8689427b1c71 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Created volume successfully. Sep 04 16:03:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-fff6f9c9-db4e-458d-a904-ccc6081b6041 req-680b2a43-e825-47d9-8406-a614476493d0 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:03:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-fff6f9c9-db4e-458d-a904-ccc6081b6041 req-680b2a43-e825-47d9-8406-a614476493d0 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:03:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-fff6f9c9-db4e-458d-a904-ccc6081b6041 req-680b2a43-e825-47d9-8406-a614476493d0 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:03:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-fff6f9c9-db4e-458d-a904-ccc6081b6041 req-680b2a43-e825-47d9-8406-a614476493d0 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787', 'name': 'volume-5517fc88-3603-4baf-a39e-270f94c7ce37', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c4fa27f4-2c01-48e9-beda-ab36b2b72adc', 'enforce_multipath': True} {{(pid=87490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 16:03:02 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-fff6f9c9-db4e-458d-a904-ccc6081b6041 req-680b2a43-e825-47d9-8406-a614476493d0 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] attachment_update completed successfully. Sep 04 16:03:04 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-8c928b19-7d5b-4d9a-8e68-2cd9fc002011 req-3e3ec8cb-30fe-4d1b-bb16-639100772e03 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Terminate volume connection completed successfully. Sep 04 16:03:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-8c928b19-7d5b-4d9a-8e68-2cd9fc002011 req-3e3ec8cb-30fe-4d1b-bb16-639100772e03 tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Deleting attachment c4fa27f4-2c01-48e9-beda-ab36b2b72adc. {{(pid=87490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 16:03:05 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c293fd7c-73d8-41ad-9443-a090df3f7aac tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Acquiring lock "cinder-5517fc88-3603-4baf-a39e-270f94c7ce37-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:03:05 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c293fd7c-73d8-41ad-9443-a090df3f7aac tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Lock "cinder-5517fc88-3603-4baf-a39e-270f94c7ce37-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:03:05 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c293fd7c-73d8-41ad-9443-a090df3f7aac tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Acquiring lock "cinder-quobyte-5517fc88-3603-4baf-a39e-270f94c7ce37" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:03:05 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c293fd7c-73d8-41ad-9443-a090df3f7aac tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Lock "cinder-quobyte-5517fc88-3603-4baf-a39e-270f94c7ce37" acquired by "delete_volume" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:03:05 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fe8c71-e61c-48c3-bb57-47bfd7df856f]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:03:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c293fd7c-73d8-41ad-9443-a090df3f7aac tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5517fc88-3603-4baf-a39e-270f94c7ce37 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:05 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5517fc88-3603-4baf-a39e-270f94c7ce37 Sep 04 16:03:05 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:05 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c293fd7c-73d8-41ad-9443-a090df3f7aac tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5517fc88-3603-4baf-a39e-270f94c7ce37" returned: 0 in 0.340s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c293fd7c-73d8-41ad-9443-a090df3f7aac tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5517fc88-3603-4baf-a39e-270f94c7ce37 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:05 devstack sudo[102295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5517fc88-3603-4baf-a39e-270f94c7ce37 Sep 04 16:03:05 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:05 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c293fd7c-73d8-41ad-9443-a090df3f7aac tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5517fc88-3603-4baf-a39e-270f94c7ce37" returned: 0 in 0.261s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c293fd7c-73d8-41ad-9443-a090df3f7aac tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Lock "cinder-quobyte-5517fc88-3603-4baf-a39e-270f94c7ce37" released by "delete_volume" :: held 0.651s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:03:06 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-c293fd7c-73d8-41ad-9443-a090df3f7aac tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Created reservations ['90d90966-2773-43e9-9f5e-d5e82ac5d9aa', 'fdb1b1fe-08c6-4df1-afbb-f324fea229c8', 'bcb0e5d4-bd7e-4067-9d5a-caf724e003ec', '3c22fb12-3ee3-436a-8c63-4221e72412c7'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:03:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c293fd7c-73d8-41ad-9443-a090df3f7aac tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:03:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c293fd7c-73d8-41ad-9443-a090df3f7aac tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:03:06 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c293fd7c-73d8-41ad-9443-a090df3f7aac tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:03:06 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c293fd7c-73d8-41ad-9443-a090df3f7aac tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:03:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c293fd7c-73d8-41ad-9443-a090df3f7aac tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:03:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c293fd7c-73d8-41ad-9443-a090df3f7aac tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:06 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:03:06 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:06 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c293fd7c-73d8-41ad-9443-a090df3f7aac tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.268s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:06 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-c293fd7c-73d8-41ad-9443-a090df3f7aac tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:03:06 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-c293fd7c-73d8-41ad-9443-a090df3f7aac tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Deleted volume successfully. Sep 04 16:03:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c293fd7c-73d8-41ad-9443-a090df3f7aac tempest-TestServerVolumeAttachScenarioOldVersion-173089036 None] Lock "cinder-5517fc88-3603-4baf-a39e-270f94c7ce37-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:03:16 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=15,cinder:UPDATE=12,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:03:16 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:UPDATE=13,cinder:SELECT=14,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:03:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-fcdcd4d5-5295-4b67-9760-a05b34d1bbdf req-2d43ed06-63cb-452c-ba8b-11196d8dfb0b tempest-TestStampPattern-560595389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:03:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-fcdcd4d5-5295-4b67-9760-a05b34d1bbdf req-2d43ed06-63cb-452c-ba8b-11196d8dfb0b tempest-TestStampPattern-560595389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:03:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-fcdcd4d5-5295-4b67-9760-a05b34d1bbdf req-2d43ed06-63cb-452c-ba8b-11196d8dfb0b tempest-TestStampPattern-560595389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:03:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-fcdcd4d5-5295-4b67-9760-a05b34d1bbdf req-2d43ed06-63cb-452c-ba8b-11196d8dfb0b tempest-TestStampPattern-560595389 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787', 'name': 'volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '99b1a815-d365-4e07-8f59-6cc4468157b0', 'enforce_multipath': True} {{(pid=87490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 16:03:18 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-fcdcd4d5-5295-4b67-9760-a05b34d1bbdf req-2d43ed06-63cb-452c-ba8b-11196d8dfb0b tempest-TestStampPattern-560595389 None] attachment_update completed successfully. Sep 04 16:03:23 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-f6e60662-5906-49d6-a648-f3b2a3159237 req-2dbcdf9c-5810-4bf7-818e-a075fc9bcf18 tempest-TestStampPattern-560595389 None] Terminate volume connection completed successfully. Sep 04 16:03:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-f6e60662-5906-49d6-a648-f3b2a3159237 req-2dbcdf9c-5810-4bf7-818e-a075fc9bcf18 tempest-TestStampPattern-560595389 None] Deleting attachment 99b1a815-d365-4e07-8f59-6cc4468157b0. {{(pid=87490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 16:03:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-00506357-b73f-418e-a3e2-91b82a992afe tempest-TestStampPattern-560595389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:03:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-00506357-b73f-418e-a3e2-91b82a992afe tempest-TestStampPattern-560595389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:03:24 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-00506357-b73f-418e-a3e2-91b82a992afe tempest-TestStampPattern-560595389 None] Creating offline snapshot 7a38e214-7d6f-49a3-b1ce-9f0c1526d105 of volume 1810f3bb-0127-4d04-8847-0f08c8e9d58a {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:03:25 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de6497b-2a5a-4091-97ac-04cb0dccaa6c]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:03:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-00506357-b73f-418e-a3e2-91b82a992afe tempest-TestStampPattern-560595389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:25 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a Sep 04 16:03:25 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:25 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-00506357-b73f-418e-a3e2-91b82a992afe tempest-TestStampPattern-560595389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a" returned: 0 in 0.406s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-00506357-b73f-418e-a3e2-91b82a992afe tempest-TestStampPattern-560595389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.7a38e214-7d6f-49a3-b1ce-9f0c1526d105 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:25 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.7a38e214-7d6f-49a3-b1ce-9f0c1526d105 1G Sep 04 16:03:25 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:25 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-00506357-b73f-418e-a3e2-91b82a992afe tempest-TestStampPattern-560595389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.7a38e214-7d6f-49a3-b1ce-9f0c1526d105 1G" returned: 0 in 0.545s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-00506357-b73f-418e-a3e2-91b82a992afe tempest-TestStampPattern-560595389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.7a38e214-7d6f-49a3-b1ce-9f0c1526d105 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:25 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.7a38e214-7d6f-49a3-b1ce-9f0c1526d105 Sep 04 16:03:25 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:26 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-00506357-b73f-418e-a3e2-91b82a992afe tempest-TestStampPattern-560595389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.7a38e214-7d6f-49a3-b1ce-9f0c1526d105" returned: 0 in 0.302s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:26 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-00506357-b73f-418e-a3e2-91b82a992afe tempest-TestStampPattern-560595389 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.7a38e214-7d6f-49a3-b1ce-9f0c1526d105 is being set with open permissions: ugo+rw Sep 04 16:03:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-00506357-b73f-418e-a3e2-91b82a992afe tempest-TestStampPattern-560595389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.7a38e214-7d6f-49a3-b1ce-9f0c1526d105 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:26 devstack sudo[102813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.7a38e214-7d6f-49a3-b1ce-9f0c1526d105 Sep 04 16:03:26 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:26 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-00506357-b73f-418e-a3e2-91b82a992afe tempest-TestStampPattern-560595389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.7a38e214-7d6f-49a3-b1ce-9f0c1526d105" returned: 0 in 0.239s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-00506357-b73f-418e-a3e2-91b82a992afe tempest-TestStampPattern-560595389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:26 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.info Sep 04 16:03:26 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:26 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-00506357-b73f-418e-a3e2-91b82a992afe tempest-TestStampPattern-560595389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.info" returned: 0 in 0.260s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:26 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-00506357-b73f-418e-a3e2-91b82a992afe tempest-TestStampPattern-560595389 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.info is being set with open permissions: ugo+rw Sep 04 16:03:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-00506357-b73f-418e-a3e2-91b82a992afe tempest-TestStampPattern-560595389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:26 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.info Sep 04 16:03:26 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:27 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-00506357-b73f-418e-a3e2-91b82a992afe tempest-TestStampPattern-560595389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.info" returned: 0 in 0.275s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-00506357-b73f-418e-a3e2-91b82a992afe tempest-TestStampPattern-560595389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.134s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:03:27 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-00506357-b73f-418e-a3e2-91b82a992afe tempest-TestStampPattern-560595389 None] Create snapshot completed successfully Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Flow 'volume_create_manager' (9fb5c9d2-51bf-442b-af84-f3d2055033ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e52d27a-674c-4294-bb8f-eb70deb90dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e52d27a-674c-4294-bb8f-eb70deb90dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2101744950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d097501-5594-474b-ac4b-f65c0b6c5ed4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e52d1924b27940b88004ec3499c87d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7a38e214-7d6f-49a3-b1ce-9f0c1526d105,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:03:35Z,use_quota=True,user_id='18f1746c6a164e908809d910b31da55b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d50b8c65-0d79-4a27-893a-88ead05e313d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d50b8c65-0d79-4a27-893a-88ead05e313d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ab194c-f840-4818-98f6-b92855f17a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ab194c-f840-4818-98f6-b92855f17a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0d097501-5594-474b-ac4b-f65c0b6c5ed4', 'volume_name': 'volume-0d097501-5594-474b-ac4b-f65c0b6c5ed4', 'volume_size': 1, 'snapshot_id': '7a38e214-7d6f-49a3-b1ce-9f0c1526d105'}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa03b5d-17ec-4cab-a285-debed455a26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa03b5d-17ec-4cab-a285-debed455a26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a0d147-ea81-4600-ad75-b1eaf1f50152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:35 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Volume 0d097501-5594-474b-ac4b-f65c0b6c5ed4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0d097501-5594-474b-ac4b-f65c0b6c5ed4', 'volume_size': 1, 'snapshot_id': '7a38e214-7d6f-49a3-b1ce-9f0c1526d105'} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Acquiring lock "cinder-quobyte-7a38e214-7d6f-49a3-b1ce-9f0c1526d105-0d097501-5594-474b-ac4b-f65c0b6c5ed4" by "_create_volume_from_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Lock "cinder-quobyte-7a38e214-7d6f-49a3-b1ce-9f0c1526d105-0d097501-5594-474b-ac4b-f65c0b6c5ed4" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Creating volume 0d097501-5594-474b-ac4b-f65c0b6c5ed4 from snapshot 7a38e214-7d6f-49a3-b1ce-9f0c1526d105 {{(pid=87490) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Acquiring lock "cinder-quobyte-0d097501-5594-474b-ac4b-f65c0b6c5ed4" by "_copy_volume_from_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Lock "cinder-quobyte-0d097501-5594-474b-ac4b-f65c0b6c5ed4" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] snapshot: 7a38e214-7d6f-49a3-b1ce-9f0c1526d105, volume: 0d097501-5594-474b-ac4b-f65c0b6c5ed4, {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[2834a055-a024-4d7a-be56-67936023e72c]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.7a38e214-7d6f-49a3-b1ce-9f0c1526d105 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:35 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.7a38e214-7d6f-49a3-b1ce-9f0c1526d105 Sep 04 16:03:35 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:35 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.7a38e214-7d6f-49a3-b1ce-9f0c1526d105" returned: 0 in 0.460s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28117cf-f83f-4803-a44c-20f13aecf310]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:03:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:35 devstack sudo[102896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a Sep 04 16:03:35 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:36 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a" returned: 0 in 0.426s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:36 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 16:03:36 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Creating direct copy from snapshot {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 16:03:36 devstack cinder-volume[87490]: DEBUG cinder.utils [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Path /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0d097501-5594-474b-ac4b-f65c0b6c5ed4 not found in is_blk_device check {{(pid=87490) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 16:03:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0d097501-5594-474b-ac4b-f65c0b6c5ed4 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:36 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0d097501-5594-474b-ac4b-f65c0b6c5ed4 Sep 04 16:03:36 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:03:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:03:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:03:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:03:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:03:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:03:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:38 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:03:38 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:38 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.372s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:38 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:03:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager._thread_info {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:03:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread count: 28 {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 16:03:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread info: [<_MainThread(MainThread, started 138899118923904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 16:03:42 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0d097501-5594-474b-ac4b-f65c0b6c5ed4" returned: 0 in 6.082s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:42 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a, size 1024.00 MB, duration 6.08 sec, destination /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0d097501-5594-474b-ac4b-f65c0b6c5ed4 {{(pid=87490) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 16:03:42 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Converted 1024.00 MB image at 168.34 MB/s Sep 04 16:03:42 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0d097501-5594-474b-ac4b-f65c0b6c5ed4 is being set with open permissions: ugo+rw Sep 04 16:03:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0d097501-5594-474b-ac4b-f65c0b6c5ed4 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:42 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0d097501-5594-474b-ac4b-f65c0b6c5ed4 Sep 04 16:03:42 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:42 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0d097501-5594-474b-ac4b-f65c0b6c5ed4" returned: 0 in 0.343s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:42 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Lock "cinder-quobyte-0d097501-5594-474b-ac4b-f65c0b6c5ed4" released by "_copy_volume_from_snapshot" :: held 7.423s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:03:42 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Lock "cinder-quobyte-7a38e214-7d6f-49a3-b1ce-9f0c1526d105-0d097501-5594-474b-ac4b-f65c0b6c5ed4" released by "_create_volume_from_snapshot" :: held 7.528s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:03:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.550s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:03:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a0d147-ea81-4600-ad75-b1eaf1f50152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d097501-5594-474b-ac4b-f65c0b6c5ed4', 'volume_size': 1, 'snapshot_id': '7a38e214-7d6f-49a3-b1ce-9f0c1526d105'}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c33aa63-bc3b-4cb0-84e4-525c79ce0117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:42 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Volume volume-0d097501-5594-474b-ac4b-f65c0b6c5ed4 (0d097501-5594-474b-ac4b-f65c0b6c5ed4): created successfully Sep 04 16:03:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c33aa63-bc3b-4cb0-84e4-525c79ce0117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Flow 'volume_create_manager' (9fb5c9d2-51bf-442b-af84-f3d2055033ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:03:42 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-c7f36843-7061-4293-bff4-3efd73fe7043 tempest-TestStampPattern-560595389 None] Created volume successfully. Sep 04 16:03:46 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:03:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Flow 'volume_create_manager' (95c93011-5980-41fb-80c2-797c8eb89330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:03:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f99c1109-bd21-4264-8bb3-fd3c53cf8fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f99c1109-bd21-4264-8bb3-fd3c53cf8fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1205530380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b5464b-4a1f-4c68-9b86-19c5f1121ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286e3b8d523941589d2bd194781c5c8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:03:47Z,use_quota=True,user_id='c2aaa7ffe0694e878f3592800d7f8a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b30b13-243d-46cf-9cf3-25f86200d50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b30b13-243d-46cf-9cf3-25f86200d50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8936913-61ef-45fd-819a-c55fb3f5e632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8936913-61ef-45fd-819a-c55fb3f5e632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24b5464b-4a1f-4c68-9b86-19c5f1121ee1', 'volume_name': 'volume-24b5464b-4a1f-4c68-9b86-19c5f1121ee1', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97690709-0e0f-485d-926c-f863b498919c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97690709-0e0f-485d-926c-f863b498919c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e18f19-7f6d-4737-826b-5c30b278ed78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:46 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Volume 24b5464b-4a1f-4c68-9b86-19c5f1121ee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24b5464b-4a1f-4c68-9b86-19c5f1121ee1', 'volume_size': 1} Sep 04 16:03:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:03:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:03:46 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1205530380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b5464b-4a1f-4c68-9b86-19c5f1121ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286e3b8d523941589d2bd194781c5c8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:03:47Z,use_quota=True,user_id='c2aaa7ffe0694e878f3592800d7f8a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:03:46 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Creating volume 24b5464b-4a1f-4c68-9b86-19c5f1121ee1 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:03:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:03:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:03:46 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:03:46 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:03:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:03:46 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:03:46 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:03:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-24b5464b-4a1f-4c68-9b86-19c5f1121ee1 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:46 devstack sudo[102987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-24b5464b-4a1f-4c68-9b86-19c5f1121ee1 1073741824 Sep 04 16:03:46 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:47 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:03:47 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Flow 'volume_create_manager' (1bf171f1-fe06-4e92-834c-09c6cef12d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:03:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0fae69b-8e5b-4e1a-bd6b-adbdaa1de79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-24b5464b-4a1f-4c68-9b86-19c5f1121ee1 1073741824" returned: 0 in 0.901s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0fae69b-8e5b-4e1a-bd6b-adbdaa1de79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-717090785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68caa950-47d0-4540-89a5-21aa7e8bd212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286e3b8d523941589d2bd194781c5c8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:03:48Z,use_quota=True,user_id='c2aaa7ffe0694e878f3592800d7f8a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715143ab-4676-43f0-b1e6-07c41d70adea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715143ab-4676-43f0-b1e6-07c41d70adea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927c87b6-484f-4225-a81b-0170739ed3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927c87b6-484f-4225-a81b-0170739ed3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68caa950-47d0-4540-89a5-21aa7e8bd212', 'volume_name': 'volume-68caa950-47d0-4540-89a5-21aa7e8bd212', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef56eee-1b42-4b64-ae90-a52f35b24fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef56eee-1b42-4b64-ae90-a52f35b24fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e999661-2201-4e12-9dd7-5dbf2f7ade71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:47 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Volume 68caa950-47d0-4540-89a5-21aa7e8bd212: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68caa950-47d0-4540-89a5-21aa7e8bd212', 'volume_size': 1} Sep 04 16:03:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:03:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-24b5464b-4a1f-4c68-9b86-19c5f1121ee1 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:48 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-24b5464b-4a1f-4c68-9b86-19c5f1121ee1 Sep 04 16:03:48 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:48 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-24b5464b-4a1f-4c68-9b86-19c5f1121ee1" returned: 0 in 0.368s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:03:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:03:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.444s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:03:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-717090785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68caa950-47d0-4540-89a5-21aa7e8bd212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286e3b8d523941589d2bd194781c5c8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:03:48Z,use_quota=True,user_id='c2aaa7ffe0694e878f3592800d7f8a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:03:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Creating volume 68caa950-47d0-4540-89a5-21aa7e8bd212 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:03:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:03:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:03:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:03:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:03:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:03:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:03:48 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:03:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-68caa950-47d0-4540-89a5-21aa7e8bd212 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e18f19-7f6d-4737-826b-5c30b278ed78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24b5464b-4a1f-4c68-9b86-19c5f1121ee1', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8b7186-9b6b-4e40-9cc9-379453d9a54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:48 devstack sudo[103010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-68caa950-47d0-4540-89a5-21aa7e8bd212 1073741824 Sep 04 16:03:48 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:48 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Volume volume-24b5464b-4a1f-4c68-9b86-19c5f1121ee1 (24b5464b-4a1f-4c68-9b86-19c5f1121ee1): created successfully Sep 04 16:03:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8b7186-9b6b-4e40-9cc9-379453d9a54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Flow 'volume_create_manager' (95c93011-5980-41fb-80c2-797c8eb89330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:03:48 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-0df58d1c-3acc-4f59-9e43-1e1e2ba5b3bf tempest-TestServerVolumeAttachmentScenario-1814170875 None] Created volume successfully. Sep 04 16:03:49 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-68caa950-47d0-4540-89a5-21aa7e8bd212 1073741824" returned: 0 in 0.897s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-68caa950-47d0-4540-89a5-21aa7e8bd212 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:03:49 devstack sudo[103017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-68caa950-47d0-4540-89a5-21aa7e8bd212 Sep 04 16:03:49 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:03:49 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root Sep 04 16:03:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-68caa950-47d0-4540-89a5-21aa7e8bd212" returned: 0 in 0.390s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:03:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:03:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:03:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e999661-2201-4e12-9dd7-5dbf2f7ade71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68caa950-47d0-4540-89a5-21aa7e8bd212', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cadd7a3f-f5a4-4ea3-9053-b7f944452054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:03:49 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Volume volume-68caa950-47d0-4540-89a5-21aa7e8bd212 (68caa950-47d0-4540-89a5-21aa7e8bd212): created successfully Sep 04 16:03:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cadd7a3f-f5a4-4ea3-9053-b7f944452054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:03:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Flow 'volume_create_manager' (1bf171f1-fe06-4e92-834c-09c6cef12d81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:03:49 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-34d094a1-486c-4ad6-97ac-02f534f4d938 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Created volume successfully. Sep 04 16:03:59 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=17,cinder:UPDATE=13,cinder:DELETE=3,cinder:INSERT=1 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:03:59 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=21,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:04:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-8a0567c6-bdbf-4aac-886b-bb21c69036a0 req-d1cf55a9-de41-42c6-92ba-602546b729b5 tempest-TestStampPattern-560595389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-8a0567c6-bdbf-4aac-886b-bb21c69036a0 req-d1cf55a9-de41-42c6-92ba-602546b729b5 tempest-TestStampPattern-560595389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-8a0567c6-bdbf-4aac-886b-bb21c69036a0 req-d1cf55a9-de41-42c6-92ba-602546b729b5 tempest-TestStampPattern-560595389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-8a0567c6-bdbf-4aac-886b-bb21c69036a0 req-d1cf55a9-de41-42c6-92ba-602546b729b5 tempest-TestStampPattern-560595389 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787', 'name': 'volume-0d097501-5594-474b-ac4b-f65c0b6c5ed4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f04607f5-8450-445c-9788-550f6a297793', 'enforce_multipath': True} {{(pid=87490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 16:04:15 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-8a0567c6-bdbf-4aac-886b-bb21c69036a0 req-d1cf55a9-de41-42c6-92ba-602546b729b5 tempest-TestStampPattern-560595389 None] attachment_update completed successfully. Sep 04 16:04:18 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-7a333629-3ec7-4dae-9e52-2555089c7ee3 req-7d021675-271d-4a39-85fe-f37f18589e12 tempest-TestStampPattern-560595389 None] Terminate volume connection completed successfully. Sep 04 16:04:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-7a333629-3ec7-4dae-9e52-2555089c7ee3 req-7d021675-271d-4a39-85fe-f37f18589e12 tempest-TestStampPattern-560595389 None] Deleting attachment f04607f5-8450-445c-9788-550f6a297793. {{(pid=87490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 16:04:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-0e98ab1a-ac21-4e5c-989c-a6eb802535da req-d7a54296-99a7-4236-84e4-9ae992b3de5a tempest-TestServerVolumeAttachmentScenario-1814170875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-0e98ab1a-ac21-4e5c-989c-a6eb802535da req-d7a54296-99a7-4236-84e4-9ae992b3de5a tempest-TestServerVolumeAttachmentScenario-1814170875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-0e98ab1a-ac21-4e5c-989c-a6eb802535da req-d7a54296-99a7-4236-84e4-9ae992b3de5a tempest-TestServerVolumeAttachmentScenario-1814170875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-0e98ab1a-ac21-4e5c-989c-a6eb802535da req-d7a54296-99a7-4236-84e4-9ae992b3de5a tempest-TestServerVolumeAttachmentScenario-1814170875 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787', 'name': 'volume-24b5464b-4a1f-4c68-9b86-19c5f1121ee1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c0b6316-2445-4499-bc41-0c8f3cc58a09', 'enforce_multipath': True} {{(pid=87490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 16:04:21 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-0e98ab1a-ac21-4e5c-989c-a6eb802535da req-d7a54296-99a7-4236-84e4-9ae992b3de5a tempest-TestServerVolumeAttachmentScenario-1814170875 None] attachment_update completed successfully. Sep 04 16:04:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-110a4d58-1d12-4638-89a0-ba54b63bedbc tempest-TestStampPattern-560595389 None] Acquiring lock "cinder-0d097501-5594-474b-ac4b-f65c0b6c5ed4-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-110a4d58-1d12-4638-89a0-ba54b63bedbc tempest-TestStampPattern-560595389 None] Lock "cinder-0d097501-5594-474b-ac4b-f65c0b6c5ed4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-110a4d58-1d12-4638-89a0-ba54b63bedbc tempest-TestStampPattern-560595389 None] Acquiring lock "cinder-quobyte-0d097501-5594-474b-ac4b-f65c0b6c5ed4" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-110a4d58-1d12-4638-89a0-ba54b63bedbc tempest-TestStampPattern-560595389 None] Lock "cinder-quobyte-0d097501-5594-474b-ac4b-f65c0b6c5ed4" acquired by "delete_volume" :: waited 0.023s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:22 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b07522-9a48-4204-ad38-2e042cf3563e]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-110a4d58-1d12-4638-89a0-ba54b63bedbc tempest-TestStampPattern-560595389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0d097501-5594-474b-ac4b-f65c0b6c5ed4 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:22 devstack sudo[104002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0d097501-5594-474b-ac4b-f65c0b6c5ed4 Sep 04 16:04:22 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:22 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-110a4d58-1d12-4638-89a0-ba54b63bedbc tempest-TestStampPattern-560595389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0d097501-5594-474b-ac4b-f65c0b6c5ed4" returned: 0 in 0.342s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-110a4d58-1d12-4638-89a0-ba54b63bedbc tempest-TestStampPattern-560595389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0d097501-5594-474b-ac4b-f65c0b6c5ed4 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:22 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0d097501-5594-474b-ac4b-f65c0b6c5ed4 Sep 04 16:04:22 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:23 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-110a4d58-1d12-4638-89a0-ba54b63bedbc tempest-TestStampPattern-560595389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0d097501-5594-474b-ac4b-f65c0b6c5ed4" returned: 0 in 0.283s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-110a4d58-1d12-4638-89a0-ba54b63bedbc tempest-TestStampPattern-560595389 None] Lock "cinder-quobyte-0d097501-5594-474b-ac4b-f65c0b6c5ed4" released by "delete_volume" :: held 0.661s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:23 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-110a4d58-1d12-4638-89a0-ba54b63bedbc tempest-TestStampPattern-560595389 None] Created reservations ['5c95b00b-6df3-4de0-9bf7-bb6f4c1d1cc7', 'c124b601-0b4d-4ed1-bc65-dde3865086fc', 'cfe4e30b-ca2e-4271-b420-e0c63dd8f6d3', '06bfc2c2-fd01-459c-a7ca-aaa6151b244b'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:04:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-110a4d58-1d12-4638-89a0-ba54b63bedbc tempest-TestStampPattern-560595389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-110a4d58-1d12-4638-89a0-ba54b63bedbc tempest-TestStampPattern-560595389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:23 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-110a4d58-1d12-4638-89a0-ba54b63bedbc tempest-TestStampPattern-560595389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:04:23 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-110a4d58-1d12-4638-89a0-ba54b63bedbc tempest-TestStampPattern-560595389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:04:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-110a4d58-1d12-4638-89a0-ba54b63bedbc tempest-TestStampPattern-560595389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-110a4d58-1d12-4638-89a0-ba54b63bedbc tempest-TestStampPattern-560595389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:23 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:04:23 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:23 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-110a4d58-1d12-4638-89a0-ba54b63bedbc tempest-TestStampPattern-560595389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.266s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:23 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-110a4d58-1d12-4638-89a0-ba54b63bedbc tempest-TestStampPattern-560595389 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:04:23 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-110a4d58-1d12-4638-89a0-ba54b63bedbc tempest-TestStampPattern-560595389 None] Deleted volume successfully. Sep 04 16:04:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-110a4d58-1d12-4638-89a0-ba54b63bedbc tempest-TestStampPattern-560595389 None] Lock "cinder-0d097501-5594-474b-ac4b-f65c0b6c5ed4-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-33c8addd-0323-4bed-997a-bd76118a2866 tempest-TestStampPattern-560595389 None] Acquiring lock "cinder-7a38e214-7d6f-49a3-b1ce-9f0c1526d105-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-33c8addd-0323-4bed-997a-bd76118a2866 tempest-TestStampPattern-560595389 None] Lock "cinder-7a38e214-7d6f-49a3-b1ce-9f0c1526d105-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-33c8addd-0323-4bed-997a-bd76118a2866 tempest-TestStampPattern-560595389 None] Acquiring lock "cinder-quobyte-1810f3bb-0127-4d04-8847-0f08c8e9d58a" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-33c8addd-0323-4bed-997a-bd76118a2866 tempest-TestStampPattern-560595389 None] Lock "cinder-quobyte-1810f3bb-0127-4d04-8847-0f08c8e9d58a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-33c8addd-0323-4bed-997a-bd76118a2866 tempest-TestStampPattern-560595389 None] Acquiring lock "cinder-quobyte-7a38e214-7d6f-49a3-b1ce-9f0c1526d105" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-33c8addd-0323-4bed-997a-bd76118a2866 tempest-TestStampPattern-560595389 None] Lock "cinder-quobyte-7a38e214-7d6f-49a3-b1ce-9f0c1526d105" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:23 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-33c8addd-0323-4bed-997a-bd76118a2866 tempest-TestStampPattern-560595389 None] Deleting offline snapshot 7a38e214-7d6f-49a3-b1ce-9f0c1526d105 of volume 1810f3bb-0127-4d04-8847-0f08c8e9d58a {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:04:23 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-33c8addd-0323-4bed-997a-bd76118a2866 tempest-TestStampPattern-560595389 None] snapshot_file for this snap is: volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.7a38e214-7d6f-49a3-b1ce-9f0c1526d105 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:04:23 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c368601-db85-4547-ad5e-fc961a369a1b]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-33c8addd-0323-4bed-997a-bd76118a2866 tempest-TestStampPattern-560595389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.7a38e214-7d6f-49a3-b1ce-9f0c1526d105 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:24 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.7a38e214-7d6f-49a3-b1ce-9f0c1526d105 Sep 04 16:04:24 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:24 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-33c8addd-0323-4bed-997a-bd76118a2866 tempest-TestStampPattern-560595389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.7a38e214-7d6f-49a3-b1ce-9f0c1526d105" returned: 0 in 0.400s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:24 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-33c8addd-0323-4bed-997a-bd76118a2866 tempest-TestStampPattern-560595389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:04:24 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01a6119-3370-4e78-bfe6-b870019303a3]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-33c8addd-0323-4bed-997a-bd76118a2866 tempest-TestStampPattern-560595389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:24 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a Sep 04 16:04:24 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-8e7e088a-e6d9-44b8-928f-804877d5f5c6 req-70d4ecb8-5336-46f7-8d52-d2cee6d423c3 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-8e7e088a-e6d9-44b8-928f-804877d5f5c6 req-70d4ecb8-5336-46f7-8d52-d2cee6d423c3 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [req-8e7e088a-e6d9-44b8-928f-804877d5f5c6 req-70d4ecb8-5336-46f7-8d52-d2cee6d423c3 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:25 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-33c8addd-0323-4bed-997a-bd76118a2866 tempest-TestStampPattern-560595389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a" returned: 0 in 0.611s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-33c8addd-0323-4bed-997a-bd76118a2866 tempest-TestStampPattern-560595389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.7a38e214-7d6f-49a3-b1ce-9f0c1526d105 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-8e7e088a-e6d9-44b8-928f-804877d5f5c6 req-70d4ecb8-5336-46f7-8d52-d2cee6d423c3 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787', 'name': 'volume-68caa950-47d0-4540-89a5-21aa7e8bd212', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '63b859af-0d9c-4fd6-9ccb-339e2e45d7ac', 'enforce_multipath': True} {{(pid=87490) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 16:04:25 devstack sudo[104034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.7a38e214-7d6f-49a3-b1ce-9f0c1526d105 Sep 04 16:04:25 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:25 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-8e7e088a-e6d9-44b8-928f-804877d5f5c6 req-70d4ecb8-5336-46f7-8d52-d2cee6d423c3 tempest-TestServerVolumeAttachmentScenario-1814170875 None] attachment_update completed successfully. Sep 04 16:04:25 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-33c8addd-0323-4bed-997a-bd76118a2866 tempest-TestStampPattern-560595389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.7a38e214-7d6f-49a3-b1ce-9f0c1526d105" returned: 0 in 0.348s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-33c8addd-0323-4bed-997a-bd76118a2866 tempest-TestStampPattern-560595389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.7a38e214-7d6f-49a3-b1ce-9f0c1526d105 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:25 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.7a38e214-7d6f-49a3-b1ce-9f0c1526d105 Sep 04 16:04:25 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:25 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-33c8addd-0323-4bed-997a-bd76118a2866 tempest-TestStampPattern-560595389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a.7a38e214-7d6f-49a3-b1ce-9f0c1526d105" returned: 0 in 0.263s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:25 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-33c8addd-0323-4bed-997a-bd76118a2866 tempest-TestStampPattern-560595389 None] Lock "cinder-quobyte-7a38e214-7d6f-49a3-b1ce-9f0c1526d105" released by "_delete_snapshot" :: held 1.734s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:25 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-33c8addd-0323-4bed-997a-bd76118a2866 tempest-TestStampPattern-560595389 None] Lock "cinder-quobyte-1810f3bb-0127-4d04-8847-0f08c8e9d58a" released by "delete_snapshot" :: held 1.760s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:25 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-33c8addd-0323-4bed-997a-bd76118a2866 tempest-TestStampPattern-560595389 None] Created reservations ['24b45049-3205-4f8e-9a62-2380ec78fcf3', 'c59b5e57-02da-41f5-8a72-c86e3a01f000', '424db2f2-6e23-485b-bdd1-1851a5b18b97', '96f64db2-2b07-45cc-ab00-e22fd54ced1c'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:04:25 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-33c8addd-0323-4bed-997a-bd76118a2866 tempest-TestStampPattern-560595389 None] Delete snapshot completed successfully. Sep 04 16:04:25 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-33c8addd-0323-4bed-997a-bd76118a2866 tempest-TestStampPattern-560595389 None] Lock "cinder-7a38e214-7d6f-49a3-b1ce-9f0c1526d105-delete_snapshot" released by "delete_snapshot" :: held 1.907s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:26 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-11ee0caf-dfe0-4d3a-8210-4b30bc2b6a37 req-1f9c0439-95cd-4724-b7d1-c4100cbdffa1 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Terminate volume connection completed successfully. Sep 04 16:04:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-11ee0caf-dfe0-4d3a-8210-4b30bc2b6a37 req-1f9c0439-95cd-4724-b7d1-c4100cbdffa1 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Deleting attachment 63b859af-0d9c-4fd6-9ccb-339e2e45d7ac. {{(pid=87490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 16:04:28 devstack cinder-volume[87490]: INFO cinder.volume.manager [req-2d5e8be5-6b0d-47d0-93f9-1b5d2dbf5164 req-d31834d3-3728-46f0-af72-bc2516eb646a tempest-TestServerVolumeAttachmentScenario-1814170875 None] Terminate volume connection completed successfully. Sep 04 16:04:28 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [req-2d5e8be5-6b0d-47d0-93f9-1b5d2dbf5164 req-d31834d3-3728-46f0-af72-bc2516eb646a tempest-TestServerVolumeAttachmentScenario-1814170875 None] Deleting attachment 7c0b6316-2445-4499-bc41-0c8f3cc58a09. {{(pid=87490) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 16:04:29 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c0f62216-ce1e-455a-8001-9de9fdcdda8e tempest-TestStampPattern-560595389 None] Acquiring lock "cinder-1810f3bb-0127-4d04-8847-0f08c8e9d58a-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:29 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c0f62216-ce1e-455a-8001-9de9fdcdda8e tempest-TestStampPattern-560595389 None] Lock "cinder-1810f3bb-0127-4d04-8847-0f08c8e9d58a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:29 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c0f62216-ce1e-455a-8001-9de9fdcdda8e tempest-TestStampPattern-560595389 None] Acquiring lock "cinder-quobyte-1810f3bb-0127-4d04-8847-0f08c8e9d58a" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:29 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c0f62216-ce1e-455a-8001-9de9fdcdda8e tempest-TestStampPattern-560595389 None] Lock "cinder-quobyte-1810f3bb-0127-4d04-8847-0f08c8e9d58a" acquired by "delete_volume" :: waited 0.023s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:29 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1e89af-66e3-467a-9557-7394d00d465c]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c0f62216-ce1e-455a-8001-9de9fdcdda8e tempest-TestStampPattern-560595389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:30 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a Sep 04 16:04:30 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:30 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c0f62216-ce1e-455a-8001-9de9fdcdda8e tempest-TestStampPattern-560595389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a" returned: 0 in 0.461s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c0f62216-ce1e-455a-8001-9de9fdcdda8e tempest-TestStampPattern-560595389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:30 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a Sep 04 16:04:30 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:30 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c0f62216-ce1e-455a-8001-9de9fdcdda8e tempest-TestStampPattern-560595389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-1810f3bb-0127-4d04-8847-0f08c8e9d58a" returned: 0 in 0.254s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:30 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c0f62216-ce1e-455a-8001-9de9fdcdda8e tempest-TestStampPattern-560595389 None] Lock "cinder-quobyte-1810f3bb-0127-4d04-8847-0f08c8e9d58a" released by "delete_volume" :: held 0.854s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:30 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-c0f62216-ce1e-455a-8001-9de9fdcdda8e tempest-TestStampPattern-560595389 None] Created reservations ['fb4e5a55-3ffc-4416-bca4-e574f4abae91', 'd1c58c33-48c6-45d4-801f-230b764bf661', '113bae21-13f3-4a43-8ca6-33ddeba3affd', '8a451bae-00f6-4be3-a599-02ea061685ae'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:04:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c0f62216-ce1e-455a-8001-9de9fdcdda8e tempest-TestStampPattern-560595389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c0f62216-ce1e-455a-8001-9de9fdcdda8e tempest-TestStampPattern-560595389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:30 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c0f62216-ce1e-455a-8001-9de9fdcdda8e tempest-TestStampPattern-560595389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:04:30 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c0f62216-ce1e-455a-8001-9de9fdcdda8e tempest-TestStampPattern-560595389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:04:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c0f62216-ce1e-455a-8001-9de9fdcdda8e tempest-TestStampPattern-560595389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c0f62216-ce1e-455a-8001-9de9fdcdda8e tempest-TestStampPattern-560595389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:30 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:04:30 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:31 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c0f62216-ce1e-455a-8001-9de9fdcdda8e tempest-TestStampPattern-560595389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.312s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:31 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-c0f62216-ce1e-455a-8001-9de9fdcdda8e tempest-TestStampPattern-560595389 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:04:31 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-c0f62216-ce1e-455a-8001-9de9fdcdda8e tempest-TestStampPattern-560595389 None] Deleted volume successfully. Sep 04 16:04:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c0f62216-ce1e-455a-8001-9de9fdcdda8e tempest-TestStampPattern-560595389 None] Lock "cinder-1810f3bb-0127-4d04-8847-0f08c8e9d58a-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f780790b-51e6-461c-9a93-d08d0a754a1c tempest-TestServerVolumeAttachmentScenario-1814170875 None] Acquiring lock "cinder-68caa950-47d0-4540-89a5-21aa7e8bd212-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f780790b-51e6-461c-9a93-d08d0a754a1c tempest-TestServerVolumeAttachmentScenario-1814170875 None] Lock "cinder-68caa950-47d0-4540-89a5-21aa7e8bd212-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f780790b-51e6-461c-9a93-d08d0a754a1c tempest-TestServerVolumeAttachmentScenario-1814170875 None] Acquiring lock "cinder-quobyte-68caa950-47d0-4540-89a5-21aa7e8bd212" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f780790b-51e6-461c-9a93-d08d0a754a1c tempest-TestServerVolumeAttachmentScenario-1814170875 None] Lock "cinder-quobyte-68caa950-47d0-4540-89a5-21aa7e8bd212" acquired by "delete_volume" :: waited 0.023s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:32 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91bc3f2-85aa-4da0-8237-562ef2a3b662]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f780790b-51e6-461c-9a93-d08d0a754a1c tempest-TestServerVolumeAttachmentScenario-1814170875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-68caa950-47d0-4540-89a5-21aa7e8bd212 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:32 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-68caa950-47d0-4540-89a5-21aa7e8bd212 Sep 04 16:04:32 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:33 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f780790b-51e6-461c-9a93-d08d0a754a1c tempest-TestServerVolumeAttachmentScenario-1814170875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-68caa950-47d0-4540-89a5-21aa7e8bd212" returned: 0 in 0.444s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f780790b-51e6-461c-9a93-d08d0a754a1c tempest-TestServerVolumeAttachmentScenario-1814170875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-68caa950-47d0-4540-89a5-21aa7e8bd212 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:33 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-68caa950-47d0-4540-89a5-21aa7e8bd212 Sep 04 16:04:33 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:33 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f780790b-51e6-461c-9a93-d08d0a754a1c tempest-TestServerVolumeAttachmentScenario-1814170875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-68caa950-47d0-4540-89a5-21aa7e8bd212" returned: 0 in 0.246s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:33 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f780790b-51e6-461c-9a93-d08d0a754a1c tempest-TestServerVolumeAttachmentScenario-1814170875 None] Lock "cinder-quobyte-68caa950-47d0-4540-89a5-21aa7e8bd212" released by "delete_volume" :: held 0.731s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:33 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-f780790b-51e6-461c-9a93-d08d0a754a1c tempest-TestServerVolumeAttachmentScenario-1814170875 None] Created reservations ['9fba76ce-48dc-4b1e-b73a-1e4087323f8b', '0f68392a-3744-46c2-8174-0cd5d26d407e', '346e5194-e3c7-433e-b8f3-728ec0221633', '49aa9136-dadd-4f89-bad5-1e588c6aeadd'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:04:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f780790b-51e6-461c-9a93-d08d0a754a1c tempest-TestServerVolumeAttachmentScenario-1814170875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f780790b-51e6-461c-9a93-d08d0a754a1c tempest-TestServerVolumeAttachmentScenario-1814170875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:33 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f780790b-51e6-461c-9a93-d08d0a754a1c tempest-TestServerVolumeAttachmentScenario-1814170875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:04:33 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f780790b-51e6-461c-9a93-d08d0a754a1c tempest-TestServerVolumeAttachmentScenario-1814170875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:04:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f780790b-51e6-461c-9a93-d08d0a754a1c tempest-TestServerVolumeAttachmentScenario-1814170875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f780790b-51e6-461c-9a93-d08d0a754a1c tempest-TestServerVolumeAttachmentScenario-1814170875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:33 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:04:33 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:33 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f780790b-51e6-461c-9a93-d08d0a754a1c tempest-TestServerVolumeAttachmentScenario-1814170875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.264s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:33 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-f780790b-51e6-461c-9a93-d08d0a754a1c tempest-TestServerVolumeAttachmentScenario-1814170875 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:04:33 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6cdf8802-6d57-4eb0-b83b-1702c5de8fe3 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Acquiring lock "cinder-24b5464b-4a1f-4c68-9b86-19c5f1121ee1-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:33 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-f780790b-51e6-461c-9a93-d08d0a754a1c tempest-TestServerVolumeAttachmentScenario-1814170875 None] Deleted volume successfully. Sep 04 16:04:33 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6cdf8802-6d57-4eb0-b83b-1702c5de8fe3 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Lock "cinder-24b5464b-4a1f-4c68-9b86-19c5f1121ee1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:33 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f780790b-51e6-461c-9a93-d08d0a754a1c tempest-TestServerVolumeAttachmentScenario-1814170875 None] Lock "cinder-68caa950-47d0-4540-89a5-21aa7e8bd212-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:33 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6cdf8802-6d57-4eb0-b83b-1702c5de8fe3 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Acquiring lock "cinder-quobyte-24b5464b-4a1f-4c68-9b86-19c5f1121ee1" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:33 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6cdf8802-6d57-4eb0-b83b-1702c5de8fe3 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Lock "cinder-quobyte-24b5464b-4a1f-4c68-9b86-19c5f1121ee1" acquired by "delete_volume" :: waited 0.016s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:34 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac2265c-a6f4-4ac3-8a90-1b8f889d95d4]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6cdf8802-6d57-4eb0-b83b-1702c5de8fe3 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-24b5464b-4a1f-4c68-9b86-19c5f1121ee1 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:34 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-24b5464b-4a1f-4c68-9b86-19c5f1121ee1 Sep 04 16:04:34 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:34 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6cdf8802-6d57-4eb0-b83b-1702c5de8fe3 tempest-TestServerVolumeAttachmentScenario-1814170875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-24b5464b-4a1f-4c68-9b86-19c5f1121ee1" returned: 0 in 0.394s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6cdf8802-6d57-4eb0-b83b-1702c5de8fe3 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-24b5464b-4a1f-4c68-9b86-19c5f1121ee1 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:34 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-24b5464b-4a1f-4c68-9b86-19c5f1121ee1 Sep 04 16:04:34 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:34 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6cdf8802-6d57-4eb0-b83b-1702c5de8fe3 tempest-TestServerVolumeAttachmentScenario-1814170875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-24b5464b-4a1f-4c68-9b86-19c5f1121ee1" returned: 0 in 0.237s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:34 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6cdf8802-6d57-4eb0-b83b-1702c5de8fe3 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Lock "cinder-quobyte-24b5464b-4a1f-4c68-9b86-19c5f1121ee1" released by "delete_volume" :: held 0.674s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:34 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-6cdf8802-6d57-4eb0-b83b-1702c5de8fe3 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Created reservations ['41597a41-25a5-44fc-953b-5cda23dc11d1', '61e8279c-0586-4944-b525-d8589f502013', '81acf173-965c-4792-8555-5f98e3ae2fcc', 'c152a990-ecf0-427e-86a8-d12f9b03b2ac'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:04:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6cdf8802-6d57-4eb0-b83b-1702c5de8fe3 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6cdf8802-6d57-4eb0-b83b-1702c5de8fe3 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-6cdf8802-6d57-4eb0-b83b-1702c5de8fe3 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:04:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-6cdf8802-6d57-4eb0-b83b-1702c5de8fe3 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:04:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6cdf8802-6d57-4eb0-b83b-1702c5de8fe3 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6cdf8802-6d57-4eb0-b83b-1702c5de8fe3 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:34 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:04:34 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:35 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6cdf8802-6d57-4eb0-b83b-1702c5de8fe3 tempest-TestServerVolumeAttachmentScenario-1814170875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.268s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:35 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-6cdf8802-6d57-4eb0-b83b-1702c5de8fe3 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:04:35 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-6cdf8802-6d57-4eb0-b83b-1702c5de8fe3 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Deleted volume successfully. Sep 04 16:04:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6cdf8802-6d57-4eb0-b83b-1702c5de8fe3 tempest-TestServerVolumeAttachmentScenario-1814170875 None] Lock "cinder-24b5464b-4a1f-4c68-9b86-19c5f1121ee1-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:04:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:04:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:04:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:38 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:04:38 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:38 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.291s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:38 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:04:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager._thread_info {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:04:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread count: 28 {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 16:04:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread info: [<_MainThread(MainThread, started 138899118923904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 16:04:44 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:04:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Flow 'volume_create_manager' (abe2c901-8d86-44d4-88f9-c3bede861391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7baf164-b3a6-48db-9298-2f54a81cc9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7baf164-b3a6-48db-9298-2f54a81cc9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1785247712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9241b186-cfb7-4fbf-994c-40afd4e7bfb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea6e37b84b36444f8bbee69917142eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:44Z,use_quota=True,user_id='0cfc6ba4496f4b06a859a6d84654489d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35b8325-474a-436b-b14e-9e94f9b09ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35b8325-474a-436b-b14e-9e94f9b09ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4edbd6e2-7afd-410d-a25f-ff30da9066fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4edbd6e2-7afd-410d-a25f-ff30da9066fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9241b186-cfb7-4fbf-994c-40afd4e7bfb5', 'volume_name': 'volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e30a709e-8e85-40c9-8ca9-db4670d962a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e30a709e-8e85-40c9-8ca9-db4670d962a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eadc6e5-fce2-4600-ba34-d56c685a94e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:44 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Volume 9241b186-cfb7-4fbf-994c-40afd4e7bfb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5', 'volume_size': 1} Sep 04 16:04:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1785247712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9241b186-cfb7-4fbf-994c-40afd4e7bfb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea6e37b84b36444f8bbee69917142eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:44Z,use_quota=True,user_id='0cfc6ba4496f4b06a859a6d84654489d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:04:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Creating volume 9241b186-cfb7-4fbf-994c-40afd4e7bfb5 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:04:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:04:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:04:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:04:44 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:04:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:44 devstack sudo[104209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5 1073741824 Sep 04 16:04:44 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:44 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5 1073741824" returned: 0 in 0.425s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:44 devstack sudo[104215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5 Sep 04 16:04:44 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:45 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5" returned: 0 in 0.269s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:04:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eadc6e5-fce2-4600-ba34-d56c685a94e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2232c577-2bf3-474f-af49-1c79ab4c4fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:45 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Volume volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5 (9241b186-cfb7-4fbf-994c-40afd4e7bfb5): created successfully Sep 04 16:04:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2232c577-2bf3-474f-af49-1c79ab4c4fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Flow 'volume_create_manager' (abe2c901-8d86-44d4-88f9-c3bede861391) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:45 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-2a72a203-2528-428b-9977-088bb55df81a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Created volume successfully. Sep 04 16:04:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-400de924-e025-45fa-80f7-1a6a8ba867b1 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-400de924-e025-45fa-80f7-1a6a8ba867b1 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-400de924-e025-45fa-80f7-1a6a8ba867b1 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Creating offline snapshot a6385b92-078f-4ef4-9ca1-4f0d50fe6aec of volume 9241b186-cfb7-4fbf-994c-40afd4e7bfb5 {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:04:45 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ee7223-e97c-4caf-8ab1-c93653e29439]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-400de924-e025-45fa-80f7-1a6a8ba867b1 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:45 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5 Sep 04 16:04:45 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:46 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-400de924-e025-45fa-80f7-1a6a8ba867b1 tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5" returned: 0 in 0.366s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-400de924-e025-45fa-80f7-1a6a8ba867b1 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5.a6385b92-078f-4ef4-9ca1-4f0d50fe6aec 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:46 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5.a6385b92-078f-4ef4-9ca1-4f0d50fe6aec 1G Sep 04 16:04:46 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:46 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-400de924-e025-45fa-80f7-1a6a8ba867b1 tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5.a6385b92-078f-4ef4-9ca1-4f0d50fe6aec 1G" returned: 0 in 0.411s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-400de924-e025-45fa-80f7-1a6a8ba867b1 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5.a6385b92-078f-4ef4-9ca1-4f0d50fe6aec {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:46 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5.a6385b92-078f-4ef4-9ca1-4f0d50fe6aec Sep 04 16:04:46 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:46 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-400de924-e025-45fa-80f7-1a6a8ba867b1 tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5.a6385b92-078f-4ef4-9ca1-4f0d50fe6aec" returned: 0 in 0.291s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:46 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-400de924-e025-45fa-80f7-1a6a8ba867b1 tempest-CreateVolumesFromSnapshotTest-1270674288 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5.a6385b92-078f-4ef4-9ca1-4f0d50fe6aec is being set with open permissions: ugo+rw Sep 04 16:04:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-400de924-e025-45fa-80f7-1a6a8ba867b1 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5.a6385b92-078f-4ef4-9ca1-4f0d50fe6aec {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:46 devstack sudo[104234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5.a6385b92-078f-4ef4-9ca1-4f0d50fe6aec Sep 04 16:04:46 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:46 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-400de924-e025-45fa-80f7-1a6a8ba867b1 tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5.a6385b92-078f-4ef4-9ca1-4f0d50fe6aec" returned: 0 in 0.231s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-400de924-e025-45fa-80f7-1a6a8ba867b1 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:47 devstack sudo[104243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5.info Sep 04 16:04:47 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:47 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-400de924-e025-45fa-80f7-1a6a8ba867b1 tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5.info" returned: 0 in 0.274s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:47 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-400de924-e025-45fa-80f7-1a6a8ba867b1 tempest-CreateVolumesFromSnapshotTest-1270674288 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5.info is being set with open permissions: ugo+rw Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-400de924-e025-45fa-80f7-1a6a8ba867b1 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:47 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5.info Sep 04 16:04:47 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Flow 'volume_create_manager' (11708b1c-fd5a-4be2-af02-ca552c2b3a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a83a30-fa61-42ff-8de3-f4144ca8bf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a83a30-fa61-42ff-8de3-f4144ca8bf76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-708403209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93171f13-eca2-4e2a-88cd-c14e82667fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd159356df04289b5b4a4fcbbb59df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:47Z,use_quota=True,user_id='e7a1704108474e8ca9f4c2473d27926c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67ca5b6-573e-4c1c-ab7a-d7719b692126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67ca5b6-573e-4c1c-ab7a-d7719b692126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b5074bb-f4de-4d80-be61-50d800000a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b5074bb-f4de-4d80-be61-50d800000a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93171f13-eca2-4e2a-88cd-c14e82667fba', 'volume_name': 'volume-93171f13-eca2-4e2a-88cd-c14e82667fba', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (287b3d96-8818-4e38-9f84-44bdf950a326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (287b3d96-8818-4e38-9f84-44bdf950a326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd45827f-b165-4913-b713-bf0717cdc22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:47 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Volume 93171f13-eca2-4e2a-88cd-c14e82667fba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93171f13-eca2-4e2a-88cd-c14e82667fba', 'volume_size': 1} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:47 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-400de924-e025-45fa-80f7-1a6a8ba867b1 tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5.info" returned: 0 in 0.301s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-400de924-e025-45fa-80f7-1a6a8ba867b1 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.977s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.130s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-708403209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93171f13-eca2-4e2a-88cd-c14e82667fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd159356df04289b5b4a4fcbbb59df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:47Z,use_quota=True,user_id='e7a1704108474e8ca9f4c2473d27926c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Creating volume 93171f13-eca2-4e2a-88cd-c14e82667fba {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:04:47 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-93171f13-eca2-4e2a-88cd-c14e82667fba 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:47 devstack sudo[104249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-93171f13-eca2-4e2a-88cd-c14e82667fba 1073741824 Sep 04 16:04:47 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:47 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-400de924-e025-45fa-80f7-1a6a8ba867b1 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Create snapshot completed successfully Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Flow 'volume_create_manager' (5f5575cd-8715-4eed-b956-1bca14c01011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2377c401-4e6d-43a8-bd54-f4e9fcaccc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2377c401-4e6d-43a8-bd54-f4e9fcaccc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1729664841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b7e42f-713d-4e75-9e01-a398175202f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd159356df04289b5b4a4fcbbb59df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:48Z,use_quota=True,user_id='e7a1704108474e8ca9f4c2473d27926c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d346517-a23d-4b77-a6b4-555c9c32e0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d346517-a23d-4b77-a6b4-555c9c32e0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581c7c7d-5ece-4e22-aa23-2142db5c35bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581c7c7d-5ece-4e22-aa23-2142db5c35bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29b7e42f-713d-4e75-9e01-a398175202f0', 'volume_name': 'volume-29b7e42f-713d-4e75-9e01-a398175202f0', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (607998c8-bf72-45e6-8c34-7cf9e6a22970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (607998c8-bf72-45e6-8c34-7cf9e6a22970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03fbd6f8-4601-4998-89fc-44cfb5b1a6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:47 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Volume 29b7e42f-713d-4e75-9e01-a398175202f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29b7e42f-713d-4e75-9e01-a398175202f0', 'volume_size': 1} Sep 04 16:04:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:04:48 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Flow 'volume_create_manager' (d223dd82-bc74-43df-a791-74a98cee884e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f679f1-ec93-41d0-aab6-ac4e930a4a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-93171f13-eca2-4e2a-88cd-c14e82667fba 1073741824" returned: 0 in 0.557s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f679f1-ec93-41d0-aab6-ac4e930a4a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-268864529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aba82be9-9db6-45a6-aa2e-9d0af89eee14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd159356df04289b5b4a4fcbbb59df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:48Z,use_quota=True,user_id='e7a1704108474e8ca9f4c2473d27926c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd14af5-e360-4b3e-80ed-e244cac4a1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd14af5-e360-4b3e-80ed-e244cac4a1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e64b654e-bf7f-44f5-82e7-4c417c86e0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e64b654e-bf7f-44f5-82e7-4c417c86e0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aba82be9-9db6-45a6-aa2e-9d0af89eee14', 'volume_name': 'volume-aba82be9-9db6-45a6-aa2e-9d0af89eee14', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (426b781b-c811-4434-bc23-22e05830cf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (426b781b-c811-4434-bc23-22e05830cf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c85ee763-3d0a-4c82-b27f-9f7046625948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:48 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Volume aba82be9-9db6-45a6-aa2e-9d0af89eee14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aba82be9-9db6-45a6-aa2e-9d0af89eee14', 'volume_size': 1} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-93171f13-eca2-4e2a-88cd-c14e82667fba {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:48 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-93171f13-eca2-4e2a-88cd-c14e82667fba Sep 04 16:04:48 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:04:48 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Flow 'volume_create_manager' (27b5eac8-a891-4cf0-aac3-6bbbb0282fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a01c7c96-7437-4c4f-a309-ea4560d2b4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-93171f13-eca2-4e2a-88cd-c14e82667fba" returned: 0 in 0.313s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.735s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1729664841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b7e42f-713d-4e75-9e01-a398175202f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd159356df04289b5b4a4fcbbb59df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:48Z,use_quota=True,user_id='e7a1704108474e8ca9f4c2473d27926c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Creating volume 29b7e42f-713d-4e75-9e01-a398175202f0 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:04:48 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-29b7e42f-713d-4e75-9e01-a398175202f0 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a01c7c96-7437-4c4f-a309-ea4560d2b4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-350574366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd159356df04289b5b4a4fcbbb59df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:48Z,use_quota=True,user_id='e7a1704108474e8ca9f4c2473d27926c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:48 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-29b7e42f-713d-4e75-9e01-a398175202f0 1073741824 Sep 04 16:04:48 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f5171c-da3e-4211-8a89-4a8a8e8288c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f5171c-da3e-4211-8a89-4a8a8e8288c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb40197d-6c03-4216-b3d1-1d2de108bc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb40197d-6c03-4216-b3d1-1d2de108bc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9', 'volume_name': 'volume-bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25c3374-646e-4595-9fa0-0f9b50abd4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25c3374-646e-4595-9fa0-0f9b50abd4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dcf2ea6-0fec-4791-94dc-ad8cd958145e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:48 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Volume bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9', 'volume_size': 1} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd45827f-b165-4913-b713-bf0717cdc22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93171f13-eca2-4e2a-88cd-c14e82667fba', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab7a230-ba68-4b4d-8f2c-26652784a936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:48 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Volume volume-93171f13-eca2-4e2a-88cd-c14e82667fba (93171f13-eca2-4e2a-88cd-c14e82667fba): created successfully Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab7a230-ba68-4b4d-8f2c-26652784a936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Flow 'volume_create_manager' (11708b1c-fd5a-4be2-af02-ca552c2b3a60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:48 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-a59fcf9b-fb71-4431-82dc-8381c300dae1 tempest-CreateVolumesFromImageTest-1220787341 None] Created volume successfully. Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Flow 'volume_create_manager' (cf514855-0f77-4eea-a8ad-ae60a0b5add9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec4b1d0b-9cbf-4018-a5c8-17a32ef2e68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec4b1d0b-9cbf-4018-a5c8-17a32ef2e68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1090207034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecf63a47-66d0-42b2-aad3-a41d7c921743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd159356df04289b5b4a4fcbbb59df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:49Z,use_quota=True,user_id='e7a1704108474e8ca9f4c2473d27926c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bfa87b0-4ad5-4256-b40b-6b7c8e00487e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bfa87b0-4ad5-4256-b40b-6b7c8e00487e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0d663f-6b7e-47f8-8644-b23729fd26aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0d663f-6b7e-47f8-8644-b23729fd26aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecf63a47-66d0-42b2-aad3-a41d7c921743', 'volume_name': 'volume-ecf63a47-66d0-42b2-aad3-a41d7c921743', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275e7e13-44c2-4c35-a08b-820cc4628153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275e7e13-44c2-4c35-a08b-820cc4628153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (387dff02-acff-4056-b984-0d3e4ea85a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:49 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Volume ecf63a47-66d0-42b2-aad3-a41d7c921743: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecf63a47-66d0-42b2-aad3-a41d7c921743', 'volume_size': 1} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:49 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-29b7e42f-713d-4e75-9e01-a398175202f0 1073741824" returned: 0 in 0.540s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-29b7e42f-713d-4e75-9e01-a398175202f0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:49 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-29b7e42f-713d-4e75-9e01-a398175202f0 Sep 04 16:04:49 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Flow 'volume_create_manager' (096d7456-68ef-4116-b66a-0e96d7c96f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42e6cfb1-1be9-42ad-8ff7-abab7b231541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42e6cfb1-1be9-42ad-8ff7-abab7b231541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2030013899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ce1c62-3133-40ce-b8a4-3ba872307caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea6e37b84b36444f8bbee69917142eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:49Z,use_quota=True,user_id='0cfc6ba4496f4b06a859a6d84654489d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986aa980-cf31-44ba-a565-a9d205b71907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986aa980-cf31-44ba-a565-a9d205b71907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8661d6-a12c-409a-94de-97a606762347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8661d6-a12c-409a-94de-97a606762347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9ce1c62-3133-40ce-b8a4-3ba872307caa', 'volume_name': 'volume-b9ce1c62-3133-40ce-b8a4-3ba872307caa', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf5d211-deb6-4fe5-968d-b799efc54557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf5d211-deb6-4fe5-968d-b799efc54557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99bcd13c-ec3c-4b52-9043-90119d775ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:49 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Volume b9ce1c62-3133-40ce-b8a4-3ba872307caa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9ce1c62-3133-40ce-b8a4-3ba872307caa', 'volume_size': 1} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:49 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-29b7e42f-713d-4e75-9e01-a398175202f0" returned: 0 in 0.306s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.247s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-268864529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aba82be9-9db6-45a6-aa2e-9d0af89eee14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd159356df04289b5b4a4fcbbb59df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:48Z,use_quota=True,user_id='e7a1704108474e8ca9f4c2473d27926c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Creating volume aba82be9-9db6-45a6-aa2e-9d0af89eee14 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:04:49 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-aba82be9-9db6-45a6-aa2e-9d0af89eee14 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03fbd6f8-4601-4998-89fc-44cfb5b1a6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29b7e42f-713d-4e75-9e01-a398175202f0', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:49 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-aba82be9-9db6-45a6-aa2e-9d0af89eee14 1073741824 Sep 04 16:04:49 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6463febc-da7f-4912-8ce9-595189d62dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:49 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Volume volume-29b7e42f-713d-4e75-9e01-a398175202f0 (29b7e42f-713d-4e75-9e01-a398175202f0): created successfully Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6463febc-da7f-4912-8ce9-595189d62dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Flow 'volume_create_manager' (5f5575cd-8715-4eed-b956-1bca14c01011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:49 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-71709e1a-0be0-4790-b5be-d2179e5560bd tempest-CreateVolumesFromImageTest-1220787341 None] Created volume successfully. Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Flow 'volume_create_manager' (3f17b3ee-f443-45c3-8a28-01f89775b708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65333746-b300-4c30-9db2-dfd4dc646e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65333746-b300-4c30-9db2-dfd4dc646e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1913112809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d5055f2-7d9e-451c-b160-21921763c9ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea6e37b84b36444f8bbee69917142eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:50Z,use_quota=True,user_id='0cfc6ba4496f4b06a859a6d84654489d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c58762-600b-48f9-9b78-9d436595d779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c58762-600b-48f9-9b78-9d436595d779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746aa6be-9fbd-4c04-9b45-40fe7c39dced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746aa6be-9fbd-4c04-9b45-40fe7c39dced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d5055f2-7d9e-451c-b160-21921763c9ff', 'volume_name': 'volume-6d5055f2-7d9e-451c-b160-21921763c9ff', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891837a0-8a20-42fe-b802-353807c4187a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891837a0-8a20-42fe-b802-353807c4187a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e28d0e-dbb4-4ddb-a1ac-f497c6cd70a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:49 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Volume 6d5055f2-7d9e-451c-b160-21921763c9ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d5055f2-7d9e-451c-b160-21921763c9ff', 'volume_size': 1} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:49 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-aba82be9-9db6-45a6-aa2e-9d0af89eee14 1073741824" returned: 0 in 0.482s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-aba82be9-9db6-45a6-aa2e-9d0af89eee14 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:50 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-aba82be9-9db6-45a6-aa2e-9d0af89eee14 Sep 04 16:04:50 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Flow 'volume_create_manager' (bef55878-ec93-4a1d-ad3a-81d1e50a42ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad91f37e-cfc8-47e8-9f2d-982b8982c45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad91f37e-cfc8-47e8-9f2d-982b8982c45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-676553463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b280d5fb-8453-4508-ba9a-8f037555bcf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea6e37b84b36444f8bbee69917142eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:50Z,use_quota=True,user_id='0cfc6ba4496f4b06a859a6d84654489d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd495ad-8e23-4cd4-9961-24d0e8660d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd495ad-8e23-4cd4-9961-24d0e8660d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71affd51-115f-4a55-9922-bb25a2dd1ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71affd51-115f-4a55-9922-bb25a2dd1ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b280d5fb-8453-4508-ba9a-8f037555bcf3', 'volume_name': 'volume-b280d5fb-8453-4508-ba9a-8f037555bcf3', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a8c6c22-6354-4c14-9b69-4fbef6996d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a8c6c22-6354-4c14-9b69-4fbef6996d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba15f3dd-0a22-4bbe-812f-4947d913cf14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:50 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Volume b280d5fb-8453-4508-ba9a-8f037555bcf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b280d5fb-8453-4508-ba9a-8f037555bcf3', 'volume_size': 1} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:50 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-aba82be9-9db6-45a6-aa2e-9d0af89eee14" returned: 0 in 0.304s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.668s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-350574366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd159356df04289b5b4a4fcbbb59df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:48Z,use_quota=True,user_id='e7a1704108474e8ca9f4c2473d27926c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Creating volume bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:04:50 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c85ee763-3d0a-4c82-b27f-9f7046625948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aba82be9-9db6-45a6-aa2e-9d0af89eee14', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:50 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9 1073741824 Sep 04 16:04:50 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a522d725-4676-4172-b10d-27c4962d563c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:50 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Volume volume-aba82be9-9db6-45a6-aa2e-9d0af89eee14 (aba82be9-9db6-45a6-aa2e-9d0af89eee14): created successfully Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a522d725-4676-4172-b10d-27c4962d563c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Flow 'volume_create_manager' (d223dd82-bc74-43df-a791-74a98cee884e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:50 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-540fff28-9265-4545-85e4-5fa03c836e28 tempest-CreateVolumesFromImageTest-1220787341 None] Created volume successfully. Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Flow 'volume_create_manager' (2b7113bd-d905-4efc-bfe1-3939d4a9f9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7a0dc7-f658-4c59-a28f-74be6a4c3879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7a0dc7-f658-4c59-a28f-74be6a4c3879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-576288438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6507a6c-48ae-4699-b334-9d7f0d0f9ec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea6e37b84b36444f8bbee69917142eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:50Z,use_quota=True,user_id='0cfc6ba4496f4b06a859a6d84654489d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cea6c993-2022-44b0-a0b3-56f6c3e3f8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cea6c993-2022-44b0-a0b3-56f6c3e3f8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d9e6f5-ff88-4c31-88a7-cbb689baec33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d9e6f5-ff88-4c31-88a7-cbb689baec33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6507a6c-48ae-4699-b334-9d7f0d0f9ec9', 'volume_name': 'volume-a6507a6c-48ae-4699-b334-9d7f0d0f9ec9', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d68ed74-8a95-46ca-a922-e4b0db15c081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d68ed74-8a95-46ca-a922-e4b0db15c081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475da56e-d218-4d8a-8f5c-3e8533886aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:50 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Volume a6507a6c-48ae-4699-b334-9d7f0d0f9ec9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6507a6c-48ae-4699-b334-9d7f0d0f9ec9', 'volume_size': 1} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:50 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9 1073741824" returned: 0 in 0.456s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:50 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9 Sep 04 16:04:50 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Flow 'volume_create_manager' (c24789eb-60e8-44be-a15a-1d7846bb6b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add8f6ef-a7fa-4b1d-9ab2-290575c8a50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add8f6ef-a7fa-4b1d-9ab2-290575c8a50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1091160751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69556898-4cfa-44df-acab-954b7ffec1d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea6e37b84b36444f8bbee69917142eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:51Z,use_quota=True,user_id='0cfc6ba4496f4b06a859a6d84654489d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b4fea63-b54a-441a-9e8c-f86dff7d0234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b4fea63-b54a-441a-9e8c-f86dff7d0234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fbc5fc7-1e70-4d7a-8368-def1585c15b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fbc5fc7-1e70-4d7a-8368-def1585c15b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69556898-4cfa-44df-acab-954b7ffec1d8', 'volume_name': 'volume-69556898-4cfa-44df-acab-954b7ffec1d8', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01e879c-170c-482d-9aa5-f7cb86c6f501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01e879c-170c-482d-9aa5-f7cb86c6f501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a82c87e-3426-41a6-9cf9-92e76c0f100e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:50 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Volume 69556898-4cfa-44df-acab-954b7ffec1d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69556898-4cfa-44df-acab-954b7ffec1d8', 'volume_size': 1} Sep 04 16:04:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:51 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9" returned: 0 in 0.251s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.019s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1090207034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecf63a47-66d0-42b2-aad3-a41d7c921743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd159356df04289b5b4a4fcbbb59df1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:49Z,use_quota=True,user_id='e7a1704108474e8ca9f4c2473d27926c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Creating volume ecf63a47-66d0-42b2-aad3-a41d7c921743 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:04:51 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ecf63a47-66d0-42b2-aad3-a41d7c921743 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dcf2ea6-0fec-4791-94dc-ad8cd958145e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b45d59-b4ef-4db2-bdea-54b61a0a97a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:51 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ecf63a47-66d0-42b2-aad3-a41d7c921743 1073741824 Sep 04 16:04:51 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:51 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Volume volume-bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9 (bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9): created successfully Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b45d59-b4ef-4db2-bdea-54b61a0a97a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Flow 'volume_create_manager' (27b5eac8-a891-4cf0-aac3-6bbbb0282fad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:51 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-02e83803-e4ae-4b5b-aa9d-71526a4a42af tempest-CreateVolumesFromImageTest-1220787341 None] Created volume successfully. Sep 04 16:04:51 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ecf63a47-66d0-42b2-aad3-a41d7c921743 1073741824" returned: 0 in 0.394s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ecf63a47-66d0-42b2-aad3-a41d7c921743 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:51 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ecf63a47-66d0-42b2-aad3-a41d7c921743 Sep 04 16:04:51 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:51 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ecf63a47-66d0-42b2-aad3-a41d7c921743" returned: 0 in 0.227s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] <== create_volume: return (657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.659s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.279s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2030013899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ce1c62-3133-40ce-b8a4-3ba872307caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea6e37b84b36444f8bbee69917142eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:49Z,use_quota=True,user_id='0cfc6ba4496f4b06a859a6d84654489d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Creating volume b9ce1c62-3133-40ce-b8a4-3ba872307caa {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:04:51 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b9ce1c62-3133-40ce-b8a4-3ba872307caa 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (387dff02-acff-4056-b984-0d3e4ea85a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecf63a47-66d0-42b2-aad3-a41d7c921743', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:51 devstack sudo[104295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b9ce1c62-3133-40ce-b8a4-3ba872307caa 1073741824 Sep 04 16:04:51 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b61a595d-9ef8-4e5f-9c43-3a5496160ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:51 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Volume volume-ecf63a47-66d0-42b2-aad3-a41d7c921743 (ecf63a47-66d0-42b2-aad3-a41d7c921743): created successfully Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b61a595d-9ef8-4e5f-9c43-3a5496160ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Flow 'volume_create_manager' (cf514855-0f77-4eea-a8ad-ae60a0b5add9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:51 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-bb7ef209-adc8-404e-897c-fcd8b5facac9 tempest-CreateVolumesFromImageTest-1220787341 None] Created volume successfully. Sep 04 16:04:52 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b9ce1c62-3133-40ce-b8a4-3ba872307caa 1073741824" returned: 0 in 0.408s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b9ce1c62-3133-40ce-b8a4-3ba872307caa {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:52 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b9ce1c62-3133-40ce-b8a4-3ba872307caa Sep 04 16:04:52 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f589fa65-7cc3-47d5-9b8c-b8c40598fc1d tempest-CreateVolumesFromImageTest-1220787341 None] Acquiring lock "cinder-ecf63a47-66d0-42b2-aad3-a41d7c921743-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f589fa65-7cc3-47d5-9b8c-b8c40598fc1d tempest-CreateVolumesFromImageTest-1220787341 None] Lock "cinder-ecf63a47-66d0-42b2-aad3-a41d7c921743-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f589fa65-7cc3-47d5-9b8c-b8c40598fc1d tempest-CreateVolumesFromImageTest-1220787341 None] Acquiring lock "cinder-quobyte-ecf63a47-66d0-42b2-aad3-a41d7c921743" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f589fa65-7cc3-47d5-9b8c-b8c40598fc1d tempest-CreateVolumesFromImageTest-1220787341 None] Lock "cinder-quobyte-ecf63a47-66d0-42b2-aad3-a41d7c921743" acquired by "delete_volume" :: waited 0.015s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[4838d7ff-7039-4262-818f-bf6e46f9fe6a]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f589fa65-7cc3-47d5-9b8c-b8c40598fc1d tempest-CreateVolumesFromImageTest-1220787341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ecf63a47-66d0-42b2-aad3-a41d7c921743 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:52 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b9ce1c62-3133-40ce-b8a4-3ba872307caa" returned: 0 in 0.274s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.665s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1913112809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d5055f2-7d9e-451c-b160-21921763c9ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea6e37b84b36444f8bbee69917142eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:50Z,use_quota=True,user_id='0cfc6ba4496f4b06a859a6d84654489d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Creating volume 6d5055f2-7d9e-451c-b160-21921763c9ff {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:04:52 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6d5055f2-7d9e-451c-b160-21921763c9ff 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99bcd13c-ec3c-4b52-9043-90119d775ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9ce1c62-3133-40ce-b8a4-3ba872307caa', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:52 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6d5055f2-7d9e-451c-b160-21921763c9ff 1073741824 Sep 04 16:04:52 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9647a0a-91bf-47fb-8e94-6e7bf19c44d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:52 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Volume volume-b9ce1c62-3133-40ce-b8a4-3ba872307caa (b9ce1c62-3133-40ce-b8a4-3ba872307caa): created successfully Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9647a0a-91bf-47fb-8e94-6e7bf19c44d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Flow 'volume_create_manager' (096d7456-68ef-4116-b66a-0e96d7c96f3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:52 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-05777455-0aca-4721-91c8-2e7850774cf2 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Created volume successfully. Sep 04 16:04:52 devstack sudo[104303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ecf63a47-66d0-42b2-aad3-a41d7c921743 Sep 04 16:04:52 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:52 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f589fa65-7cc3-47d5-9b8c-b8c40598fc1d tempest-CreateVolumesFromImageTest-1220787341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ecf63a47-66d0-42b2-aad3-a41d7c921743" returned: 0 in 0.358s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f589fa65-7cc3-47d5-9b8c-b8c40598fc1d tempest-CreateVolumesFromImageTest-1220787341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ecf63a47-66d0-42b2-aad3-a41d7c921743 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:52 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ecf63a47-66d0-42b2-aad3-a41d7c921743 Sep 04 16:04:52 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:52 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6d5055f2-7d9e-451c-b160-21921763c9ff 1073741824" returned: 0 in 0.483s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6d5055f2-7d9e-451c-b160-21921763c9ff {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:53 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6d5055f2-7d9e-451c-b160-21921763c9ff Sep 04 16:04:53 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:53 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f589fa65-7cc3-47d5-9b8c-b8c40598fc1d tempest-CreateVolumesFromImageTest-1220787341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ecf63a47-66d0-42b2-aad3-a41d7c921743" returned: 0 in 0.247s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f589fa65-7cc3-47d5-9b8c-b8c40598fc1d tempest-CreateVolumesFromImageTest-1220787341 None] Lock "cinder-quobyte-ecf63a47-66d0-42b2-aad3-a41d7c921743" released by "delete_volume" :: held 0.641s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-f589fa65-7cc3-47d5-9b8c-b8c40598fc1d tempest-CreateVolumesFromImageTest-1220787341 None] Created reservations ['16b03d9c-859e-420d-96c8-4b7ae874b694', '375b3dad-29c9-4e8c-ac40-29bf64efb379', '61b85c78-2afe-4f4e-ab88-0f143bd258e2', '2f5e61bc-fefa-4adf-a49a-bac69f518fb2'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f589fa65-7cc3-47d5-9b8c-b8c40598fc1d tempest-CreateVolumesFromImageTest-1220787341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f589fa65-7cc3-47d5-9b8c-b8c40598fc1d tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f589fa65-7cc3-47d5-9b8c-b8c40598fc1d tempest-CreateVolumesFromImageTest-1220787341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f589fa65-7cc3-47d5-9b8c-b8c40598fc1d tempest-CreateVolumesFromImageTest-1220787341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f589fa65-7cc3-47d5-9b8c-b8c40598fc1d tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f589fa65-7cc3-47d5-9b8c-b8c40598fc1d tempest-CreateVolumesFromImageTest-1220787341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:53 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:04:53 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:53 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6d5055f2-7d9e-451c-b160-21921763c9ff" returned: 0 in 0.275s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.054s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-676553463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b280d5fb-8453-4508-ba9a-8f037555bcf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea6e37b84b36444f8bbee69917142eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:50Z,use_quota=True,user_id='0cfc6ba4496f4b06a859a6d84654489d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Creating volume b280d5fb-8453-4508-ba9a-8f037555bcf3 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:04:53 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b280d5fb-8453-4508-ba9a-8f037555bcf3 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e28d0e-dbb4-4ddb-a1ac-f497c6cd70a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d5055f2-7d9e-451c-b160-21921763c9ff', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:53 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b280d5fb-8453-4508-ba9a-8f037555bcf3 1073741824 Sep 04 16:04:53 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35daaa4e-a7ff-4548-b00e-36ab2a865293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:53 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Volume volume-6d5055f2-7d9e-451c-b160-21921763c9ff (6d5055f2-7d9e-451c-b160-21921763c9ff): created successfully Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35daaa4e-a7ff-4548-b00e-36ab2a865293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Flow 'volume_create_manager' (3f17b3ee-f443-45c3-8a28-01f89775b708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:53 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-2f104181-25cc-45f0-b8c4-0c0797f39a6d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Created volume successfully. Sep 04 16:04:53 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f589fa65-7cc3-47d5-9b8c-b8c40598fc1d tempest-CreateVolumesFromImageTest-1220787341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.277s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-f589fa65-7cc3-47d5-9b8c-b8c40598fc1d tempest-CreateVolumesFromImageTest-1220787341 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:04:53 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-f589fa65-7cc3-47d5-9b8c-b8c40598fc1d tempest-CreateVolumesFromImageTest-1220787341 None] Deleted volume successfully. Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f589fa65-7cc3-47d5-9b8c-b8c40598fc1d tempest-CreateVolumesFromImageTest-1220787341 None] Lock "cinder-ecf63a47-66d0-42b2-aad3-a41d7c921743-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f4fd206a-5a77-4a76-8064-6d38058d151a tempest-CreateVolumesFromImageTest-1220787341 None] Acquiring lock "cinder-bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f4fd206a-5a77-4a76-8064-6d38058d151a tempest-CreateVolumesFromImageTest-1220787341 None] Lock "cinder-bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f4fd206a-5a77-4a76-8064-6d38058d151a tempest-CreateVolumesFromImageTest-1220787341 None] Acquiring lock "cinder-quobyte-bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f4fd206a-5a77-4a76-8064-6d38058d151a tempest-CreateVolumesFromImageTest-1220787341 None] Lock "cinder-quobyte-bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9" acquired by "delete_volume" :: waited 0.016s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ea09ec-202b-48b9-aafc-b4b5fdeda421]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f4fd206a-5a77-4a76-8064-6d38058d151a tempest-CreateVolumesFromImageTest-1220787341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:53 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:53 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9 Sep 04 16:04:53 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b280d5fb-8453-4508-ba9a-8f037555bcf3 1073741824" returned: 0 in 0.476s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b280d5fb-8453-4508-ba9a-8f037555bcf3 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:53 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b280d5fb-8453-4508-ba9a-8f037555bcf3 Sep 04 16:04:53 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:54 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f4fd206a-5a77-4a76-8064-6d38058d151a tempest-CreateVolumesFromImageTest-1220787341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9" returned: 0 in 0.404s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f4fd206a-5a77-4a76-8064-6d38058d151a tempest-CreateVolumesFromImageTest-1220787341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:54 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9 Sep 04 16:04:54 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:54 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b280d5fb-8453-4508-ba9a-8f037555bcf3" returned: 0 in 0.290s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.484s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-576288438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6507a6c-48ae-4699-b334-9d7f0d0f9ec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea6e37b84b36444f8bbee69917142eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:50Z,use_quota=True,user_id='0cfc6ba4496f4b06a859a6d84654489d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Creating volume a6507a6c-48ae-4699-b334-9d7f0d0f9ec9 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:04:54 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a6507a6c-48ae-4699-b334-9d7f0d0f9ec9 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba15f3dd-0a22-4bbe-812f-4947d913cf14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b280d5fb-8453-4508-ba9a-8f037555bcf3', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da76d94-87fb-4fa8-bcbd-0aa63a2af084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:54 devstack sudo[104339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a6507a6c-48ae-4699-b334-9d7f0d0f9ec9 1073741824 Sep 04 16:04:54 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:54 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Volume volume-b280d5fb-8453-4508-ba9a-8f037555bcf3 (b280d5fb-8453-4508-ba9a-8f037555bcf3): created successfully Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da76d94-87fb-4fa8-bcbd-0aa63a2af084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Flow 'volume_create_manager' (bef55878-ec93-4a1d-ad3a-81d1e50a42ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:54 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-be498777-8244-4e7a-863b-e2bc1aa19122 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Created volume successfully. Sep 04 16:04:54 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f4fd206a-5a77-4a76-8064-6d38058d151a tempest-CreateVolumesFromImageTest-1220787341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9" returned: 0 in 0.281s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f4fd206a-5a77-4a76-8064-6d38058d151a tempest-CreateVolumesFromImageTest-1220787341 None] Lock "cinder-quobyte-bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9" released by "delete_volume" :: held 0.727s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-f4fd206a-5a77-4a76-8064-6d38058d151a tempest-CreateVolumesFromImageTest-1220787341 None] Created reservations ['233e1315-8332-463f-b248-bb7c99644420', '0018bed4-c767-49a6-aa92-a1c161f5b053', '35e7736a-411c-4869-8b56-484d237f3a84', 'ff6013f7-538f-4fc0-98e2-73f743be7e7e'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f4fd206a-5a77-4a76-8064-6d38058d151a tempest-CreateVolumesFromImageTest-1220787341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f4fd206a-5a77-4a76-8064-6d38058d151a tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f4fd206a-5a77-4a76-8064-6d38058d151a tempest-CreateVolumesFromImageTest-1220787341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f4fd206a-5a77-4a76-8064-6d38058d151a tempest-CreateVolumesFromImageTest-1220787341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f4fd206a-5a77-4a76-8064-6d38058d151a tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f4fd206a-5a77-4a76-8064-6d38058d151a tempest-CreateVolumesFromImageTest-1220787341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:54 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:04:54 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:54 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a6507a6c-48ae-4699-b334-9d7f0d0f9ec9 1073741824" returned: 0 in 0.525s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a6507a6c-48ae-4699-b334-9d7f0d0f9ec9 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:54 devstack sudo[104349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a6507a6c-48ae-4699-b334-9d7f0d0f9ec9 Sep 04 16:04:54 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-9769dea2-4262-43b9-bc97-a1e746fc8393 tempest-CreateVolumesFromImageTest-1220787341 None] Acquiring lock "cinder-aba82be9-9db6-45a6-aa2e-9d0af89eee14-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:54 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f4fd206a-5a77-4a76-8064-6d38058d151a tempest-CreateVolumesFromImageTest-1220787341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.264s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-f4fd206a-5a77-4a76-8064-6d38058d151a tempest-CreateVolumesFromImageTest-1220787341 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:04:54 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-f4fd206a-5a77-4a76-8064-6d38058d151a tempest-CreateVolumesFromImageTest-1220787341 None] Deleted volume successfully. Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-9769dea2-4262-43b9-bc97-a1e746fc8393 tempest-CreateVolumesFromImageTest-1220787341 None] Lock "cinder-aba82be9-9db6-45a6-aa2e-9d0af89eee14-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f4fd206a-5a77-4a76-8064-6d38058d151a tempest-CreateVolumesFromImageTest-1220787341 None] Lock "cinder-bc4a95fe-ecb0-4b1e-a44b-58e91f3ca6b9-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-9769dea2-4262-43b9-bc97-a1e746fc8393 tempest-CreateVolumesFromImageTest-1220787341 None] Acquiring lock "cinder-quobyte-aba82be9-9db6-45a6-aa2e-9d0af89eee14" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-9769dea2-4262-43b9-bc97-a1e746fc8393 tempest-CreateVolumesFromImageTest-1220787341 None] Lock "cinder-quobyte-aba82be9-9db6-45a6-aa2e-9d0af89eee14" acquired by "delete_volume" :: waited 0.016s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bdd3b0-227e-4c61-92c9-af62b1406134]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9769dea2-4262-43b9-bc97-a1e746fc8393 tempest-CreateVolumesFromImageTest-1220787341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-aba82be9-9db6-45a6-aa2e-9d0af89eee14 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:54 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-aba82be9-9db6-45a6-aa2e-9d0af89eee14 Sep 04 16:04:54 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:54 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a6507a6c-48ae-4699-b334-9d7f0d0f9ec9" returned: 0 in 0.282s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.984s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1091160751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69556898-4cfa-44df-acab-954b7ffec1d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea6e37b84b36444f8bbee69917142eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:04:51Z,use_quota=True,user_id='0cfc6ba4496f4b06a859a6d84654489d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Creating volume 69556898-4cfa-44df-acab-954b7ffec1d8 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:04:54 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-69556898-4cfa-44df-acab-954b7ffec1d8 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:54 devstack sudo[104354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-69556898-4cfa-44df-acab-954b7ffec1d8 1073741824 Sep 04 16:04:54 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475da56e-d218-4d8a-8f5c-3e8533886aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6507a6c-48ae-4699-b334-9d7f0d0f9ec9', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64dc8381-68ee-484e-bb6e-7c929830bbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:55 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Volume volume-a6507a6c-48ae-4699-b334-9d7f0d0f9ec9 (a6507a6c-48ae-4699-b334-9d7f0d0f9ec9): created successfully Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64dc8381-68ee-484e-bb6e-7c929830bbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Flow 'volume_create_manager' (2b7113bd-d905-4efc-bfe1-3939d4a9f9a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:55 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-2bdb9001-8ba4-48a2-bc23-da84c0cd5de6 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Created volume successfully. Sep 04 16:04:55 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9769dea2-4262-43b9-bc97-a1e746fc8393 tempest-CreateVolumesFromImageTest-1220787341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-aba82be9-9db6-45a6-aa2e-9d0af89eee14" returned: 0 in 0.388s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9769dea2-4262-43b9-bc97-a1e746fc8393 tempest-CreateVolumesFromImageTest-1220787341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-aba82be9-9db6-45a6-aa2e-9d0af89eee14 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:55 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-aba82be9-9db6-45a6-aa2e-9d0af89eee14 Sep 04 16:04:55 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:55 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-69556898-4cfa-44df-acab-954b7ffec1d8 1073741824" returned: 0 in 0.449s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-69556898-4cfa-44df-acab-954b7ffec1d8 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:55 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-69556898-4cfa-44df-acab-954b7ffec1d8 Sep 04 16:04:55 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:55 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9769dea2-4262-43b9-bc97-a1e746fc8393 tempest-CreateVolumesFromImageTest-1220787341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-aba82be9-9db6-45a6-aa2e-9d0af89eee14" returned: 0 in 0.264s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-9769dea2-4262-43b9-bc97-a1e746fc8393 tempest-CreateVolumesFromImageTest-1220787341 None] Lock "cinder-quobyte-aba82be9-9db6-45a6-aa2e-9d0af89eee14" released by "delete_volume" :: held 0.710s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-9769dea2-4262-43b9-bc97-a1e746fc8393 tempest-CreateVolumesFromImageTest-1220787341 None] Created reservations ['0d8180b5-3b55-459d-8909-13c98abec33b', '13c013fd-c544-46b7-b928-feb47d97f509', '4a7599b7-ebb2-443c-829f-7c565c37f2d6', '936d1c0d-1925-43a6-a726-d97a9d97f428'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9769dea2-4262-43b9-bc97-a1e746fc8393 tempest-CreateVolumesFromImageTest-1220787341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9769dea2-4262-43b9-bc97-a1e746fc8393 tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9769dea2-4262-43b9-bc97-a1e746fc8393 tempest-CreateVolumesFromImageTest-1220787341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9769dea2-4262-43b9-bc97-a1e746fc8393 tempest-CreateVolumesFromImageTest-1220787341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9769dea2-4262-43b9-bc97-a1e746fc8393 tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9769dea2-4262-43b9-bc97-a1e746fc8393 tempest-CreateVolumesFromImageTest-1220787341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:55 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:04:55 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:55 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-69556898-4cfa-44df-acab-954b7ffec1d8" returned: 0 in 0.289s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a82c87e-3426-41a6-9cf9-92e76c0f100e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69556898-4cfa-44df-acab-954b7ffec1d8', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4121f0ff-af6d-4370-8d50-6185f039572a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:04:55 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Volume volume-69556898-4cfa-44df-acab-954b7ffec1d8 (69556898-4cfa-44df-acab-954b7ffec1d8): created successfully Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4121f0ff-af6d-4370-8d50-6185f039572a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Flow 'volume_create_manager' (c24789eb-60e8-44be-a15a-1d7846bb6b34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:04:55 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-3229a198-64f8-4418-b9ab-4fd340f6ed7a tempest-CreateVolumesFromSnapshotTest-1270674288 None] Created volume successfully. Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1b43ccc5-b933-43b0-9474-60615568311f tempest-CreateVolumesFromImageTest-1220787341 None] Acquiring lock "cinder-29b7e42f-713d-4e75-9e01-a398175202f0-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1b43ccc5-b933-43b0-9474-60615568311f tempest-CreateVolumesFromImageTest-1220787341 None] Lock "cinder-29b7e42f-713d-4e75-9e01-a398175202f0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1b43ccc5-b933-43b0-9474-60615568311f tempest-CreateVolumesFromImageTest-1220787341 None] Acquiring lock "cinder-quobyte-29b7e42f-713d-4e75-9e01-a398175202f0" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:55 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9769dea2-4262-43b9-bc97-a1e746fc8393 tempest-CreateVolumesFromImageTest-1220787341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.268s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-9769dea2-4262-43b9-bc97-a1e746fc8393 tempest-CreateVolumesFromImageTest-1220787341 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:04:55 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-9769dea2-4262-43b9-bc97-a1e746fc8393 tempest-CreateVolumesFromImageTest-1220787341 None] Deleted volume successfully. Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1b43ccc5-b933-43b0-9474-60615568311f tempest-CreateVolumesFromImageTest-1220787341 None] Lock "cinder-quobyte-29b7e42f-713d-4e75-9e01-a398175202f0" acquired by "delete_volume" :: waited 0.027s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-9769dea2-4262-43b9-bc97-a1e746fc8393 tempest-CreateVolumesFromImageTest-1220787341 None] Lock "cinder-aba82be9-9db6-45a6-aa2e-9d0af89eee14-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[465da37e-5457-4113-a130-0bd385ddea25]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1b43ccc5-b933-43b0-9474-60615568311f tempest-CreateVolumesFromImageTest-1220787341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-29b7e42f-713d-4e75-9e01-a398175202f0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:56 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-29b7e42f-713d-4e75-9e01-a398175202f0 Sep 04 16:04:56 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:56 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1b43ccc5-b933-43b0-9474-60615568311f tempest-CreateVolumesFromImageTest-1220787341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-29b7e42f-713d-4e75-9e01-a398175202f0" returned: 0 in 0.352s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1b43ccc5-b933-43b0-9474-60615568311f tempest-CreateVolumesFromImageTest-1220787341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-29b7e42f-713d-4e75-9e01-a398175202f0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:56 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-29b7e42f-713d-4e75-9e01-a398175202f0 Sep 04 16:04:56 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-9d81fdf3-7335-4db6-ba56-de7d3cbb7640 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "cinder-69556898-4cfa-44df-acab-954b7ffec1d8-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-9d81fdf3-7335-4db6-ba56-de7d3cbb7640 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-69556898-4cfa-44df-acab-954b7ffec1d8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-9d81fdf3-7335-4db6-ba56-de7d3cbb7640 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "cinder-quobyte-69556898-4cfa-44df-acab-954b7ffec1d8" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-9d81fdf3-7335-4db6-ba56-de7d3cbb7640 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-quobyte-69556898-4cfa-44df-acab-954b7ffec1d8" acquired by "delete_volume" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:56 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b891619-8a72-41ce-b2f3-0fa1e3c362c2]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9d81fdf3-7335-4db6-ba56-de7d3cbb7640 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-69556898-4cfa-44df-acab-954b7ffec1d8 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:56 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1b43ccc5-b933-43b0-9474-60615568311f tempest-CreateVolumesFromImageTest-1220787341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-29b7e42f-713d-4e75-9e01-a398175202f0" returned: 0 in 0.258s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1b43ccc5-b933-43b0-9474-60615568311f tempest-CreateVolumesFromImageTest-1220787341 None] Lock "cinder-quobyte-29b7e42f-713d-4e75-9e01-a398175202f0" released by "delete_volume" :: held 0.658s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:56 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-69556898-4cfa-44df-acab-954b7ffec1d8 Sep 04 16:04:56 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:56 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-1b43ccc5-b933-43b0-9474-60615568311f tempest-CreateVolumesFromImageTest-1220787341 None] Created reservations ['be05090a-52b5-432c-ae75-9fdbba900047', '74f6369c-a55b-40a1-b469-c0ba71c7f0ad', '9d311c20-9317-484d-9dcf-65d11b4e1177', '853a307f-d5bf-4c69-8775-80841cb3f053'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:04:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1b43ccc5-b933-43b0-9474-60615568311f tempest-CreateVolumesFromImageTest-1220787341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1b43ccc5-b933-43b0-9474-60615568311f tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1b43ccc5-b933-43b0-9474-60615568311f tempest-CreateVolumesFromImageTest-1220787341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:04:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1b43ccc5-b933-43b0-9474-60615568311f tempest-CreateVolumesFromImageTest-1220787341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:04:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1b43ccc5-b933-43b0-9474-60615568311f tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1b43ccc5-b933-43b0-9474-60615568311f tempest-CreateVolumesFromImageTest-1220787341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:56 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:04:56 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:56 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9d81fdf3-7335-4db6-ba56-de7d3cbb7640 tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-69556898-4cfa-44df-acab-954b7ffec1d8" returned: 0 in 0.391s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9d81fdf3-7335-4db6-ba56-de7d3cbb7640 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-69556898-4cfa-44df-acab-954b7ffec1d8 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:56 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-69556898-4cfa-44df-acab-954b7ffec1d8 Sep 04 16:04:56 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:56 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1b43ccc5-b933-43b0-9474-60615568311f tempest-CreateVolumesFromImageTest-1220787341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.245s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:56 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-1b43ccc5-b933-43b0-9474-60615568311f tempest-CreateVolumesFromImageTest-1220787341 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:04:56 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-1b43ccc5-b933-43b0-9474-60615568311f tempest-CreateVolumesFromImageTest-1220787341 None] Deleted volume successfully. Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1b43ccc5-b933-43b0-9474-60615568311f tempest-CreateVolumesFromImageTest-1220787341 None] Lock "cinder-29b7e42f-713d-4e75-9e01-a398175202f0-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-67725deb-cbfe-4a8b-adaf-4b2f2aa54141 tempest-CreateVolumesFromImageTest-1220787341 None] Acquiring lock "cinder-93171f13-eca2-4e2a-88cd-c14e82667fba-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-67725deb-cbfe-4a8b-adaf-4b2f2aa54141 tempest-CreateVolumesFromImageTest-1220787341 None] Lock "cinder-93171f13-eca2-4e2a-88cd-c14e82667fba-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-67725deb-cbfe-4a8b-adaf-4b2f2aa54141 tempest-CreateVolumesFromImageTest-1220787341 None] Acquiring lock "cinder-quobyte-93171f13-eca2-4e2a-88cd-c14e82667fba" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-67725deb-cbfe-4a8b-adaf-4b2f2aa54141 tempest-CreateVolumesFromImageTest-1220787341 None] Lock "cinder-quobyte-93171f13-eca2-4e2a-88cd-c14e82667fba" acquired by "delete_volume" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:57 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9d81fdf3-7335-4db6-ba56-de7d3cbb7640 tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-69556898-4cfa-44df-acab-954b7ffec1d8" returned: 0 in 0.267s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7db651f-1eb0-44b9-9d9f-68ff2e82e4ea]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-67725deb-cbfe-4a8b-adaf-4b2f2aa54141 tempest-CreateVolumesFromImageTest-1220787341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-93171f13-eca2-4e2a-88cd-c14e82667fba {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-9d81fdf3-7335-4db6-ba56-de7d3cbb7640 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-quobyte-69556898-4cfa-44df-acab-954b7ffec1d8" released by "delete_volume" :: held 0.717s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-9d81fdf3-7335-4db6-ba56-de7d3cbb7640 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Created reservations ['76bbe0b8-7112-4227-ad89-a964fae26423', '1ac31229-1a48-44bb-b0f3-2e261bdf9b72', '040e6f0d-e882-4e71-b900-5d080be6b59e', '3699ae8c-7029-4a0a-a81f-5884e4fc67d1'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:04:57 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-93171f13-eca2-4e2a-88cd-c14e82667fba Sep 04 16:04:57 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9d81fdf3-7335-4db6-ba56-de7d3cbb7640 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9d81fdf3-7335-4db6-ba56-de7d3cbb7640 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9d81fdf3-7335-4db6-ba56-de7d3cbb7640 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9d81fdf3-7335-4db6-ba56-de7d3cbb7640 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9d81fdf3-7335-4db6-ba56-de7d3cbb7640 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9d81fdf3-7335-4db6-ba56-de7d3cbb7640 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:57 devstack sudo[104393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:04:57 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:57 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-be7322df-13cd-4cfe-95cf-bd26996d028d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "cinder-a6507a6c-48ae-4699-b334-9d7f0d0f9ec9-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-67725deb-cbfe-4a8b-adaf-4b2f2aa54141 tempest-CreateVolumesFromImageTest-1220787341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-93171f13-eca2-4e2a-88cd-c14e82667fba" returned: 0 in 0.412s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-67725deb-cbfe-4a8b-adaf-4b2f2aa54141 tempest-CreateVolumesFromImageTest-1220787341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-93171f13-eca2-4e2a-88cd-c14e82667fba {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:57 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9d81fdf3-7335-4db6-ba56-de7d3cbb7640 tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.267s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-9d81fdf3-7335-4db6-ba56-de7d3cbb7640 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:04:57 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-93171f13-eca2-4e2a-88cd-c14e82667fba Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-be7322df-13cd-4cfe-95cf-bd26996d028d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-a6507a6c-48ae-4699-b334-9d7f0d0f9ec9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:57 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:57 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-9d81fdf3-7335-4db6-ba56-de7d3cbb7640 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Deleted volume successfully. Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-9d81fdf3-7335-4db6-ba56-de7d3cbb7640 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-69556898-4cfa-44df-acab-954b7ffec1d8-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-be7322df-13cd-4cfe-95cf-bd26996d028d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "cinder-quobyte-a6507a6c-48ae-4699-b334-9d7f0d0f9ec9" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-be7322df-13cd-4cfe-95cf-bd26996d028d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-quobyte-a6507a6c-48ae-4699-b334-9d7f0d0f9ec9" acquired by "delete_volume" :: waited 0.016s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac82abf4-eacc-47ea-865c-126cd14a47d6]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-be7322df-13cd-4cfe-95cf-bd26996d028d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a6507a6c-48ae-4699-b334-9d7f0d0f9ec9 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:57 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a6507a6c-48ae-4699-b334-9d7f0d0f9ec9 Sep 04 16:04:57 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:57 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-67725deb-cbfe-4a8b-adaf-4b2f2aa54141 tempest-CreateVolumesFromImageTest-1220787341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-93171f13-eca2-4e2a-88cd-c14e82667fba" returned: 0 in 0.251s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-67725deb-cbfe-4a8b-adaf-4b2f2aa54141 tempest-CreateVolumesFromImageTest-1220787341 None] Lock "cinder-quobyte-93171f13-eca2-4e2a-88cd-c14e82667fba" released by "delete_volume" :: held 0.714s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-67725deb-cbfe-4a8b-adaf-4b2f2aa54141 tempest-CreateVolumesFromImageTest-1220787341 None] Created reservations ['f4995fec-3607-4dfa-95fd-686afeab2388', '7aefd292-194c-41e6-beb2-982270fddd31', 'b4c6553b-bc03-485e-9f73-1e921daf3877', 'c561d0ed-3ab1-4b73-b3c1-a2c6cc899f98'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-67725deb-cbfe-4a8b-adaf-4b2f2aa54141 tempest-CreateVolumesFromImageTest-1220787341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-67725deb-cbfe-4a8b-adaf-4b2f2aa54141 tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-67725deb-cbfe-4a8b-adaf-4b2f2aa54141 tempest-CreateVolumesFromImageTest-1220787341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-67725deb-cbfe-4a8b-adaf-4b2f2aa54141 tempest-CreateVolumesFromImageTest-1220787341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-67725deb-cbfe-4a8b-adaf-4b2f2aa54141 tempest-CreateVolumesFromImageTest-1220787341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-67725deb-cbfe-4a8b-adaf-4b2f2aa54141 tempest-CreateVolumesFromImageTest-1220787341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:58 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:04:58 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:58 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-be7322df-13cd-4cfe-95cf-bd26996d028d tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a6507a6c-48ae-4699-b334-9d7f0d0f9ec9" returned: 0 in 0.367s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-be7322df-13cd-4cfe-95cf-bd26996d028d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a6507a6c-48ae-4699-b334-9d7f0d0f9ec9 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:58 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a6507a6c-48ae-4699-b334-9d7f0d0f9ec9 Sep 04 16:04:58 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:58 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-67725deb-cbfe-4a8b-adaf-4b2f2aa54141 tempest-CreateVolumesFromImageTest-1220787341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.258s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:58 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-67725deb-cbfe-4a8b-adaf-4b2f2aa54141 tempest-CreateVolumesFromImageTest-1220787341 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:04:58 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-67725deb-cbfe-4a8b-adaf-4b2f2aa54141 tempest-CreateVolumesFromImageTest-1220787341 None] Deleted volume successfully. Sep 04 16:04:58 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-67725deb-cbfe-4a8b-adaf-4b2f2aa54141 tempest-CreateVolumesFromImageTest-1220787341 None] Lock "cinder-93171f13-eca2-4e2a-88cd-c14e82667fba-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:58 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-be7322df-13cd-4cfe-95cf-bd26996d028d tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a6507a6c-48ae-4699-b334-9d7f0d0f9ec9" returned: 0 in 0.260s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:58 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-be7322df-13cd-4cfe-95cf-bd26996d028d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-quobyte-a6507a6c-48ae-4699-b334-9d7f0d0f9ec9" released by "delete_volume" :: held 0.665s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:58 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-be7322df-13cd-4cfe-95cf-bd26996d028d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Created reservations ['cc2f93b6-8503-4f30-9ef9-cfa994fce1d3', 'da418e0a-a954-4643-ade6-ba73c7076d9a', 'b4b36ddc-e4c4-42d2-8ed1-75004fe50469', 'f5bf50d7-1408-4eef-828a-9a853db9df0f'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:04:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-be7322df-13cd-4cfe-95cf-bd26996d028d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-be7322df-13cd-4cfe-95cf-bd26996d028d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-be7322df-13cd-4cfe-95cf-bd26996d028d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:04:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-be7322df-13cd-4cfe-95cf-bd26996d028d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:04:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-be7322df-13cd-4cfe-95cf-bd26996d028d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-be7322df-13cd-4cfe-95cf-bd26996d028d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:58 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:04:58 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:58 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-be7322df-13cd-4cfe-95cf-bd26996d028d tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.257s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:58 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-be7322df-13cd-4cfe-95cf-bd26996d028d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:04:58 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-be7322df-13cd-4cfe-95cf-bd26996d028d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Deleted volume successfully. Sep 04 16:04:58 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-be7322df-13cd-4cfe-95cf-bd26996d028d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-a6507a6c-48ae-4699-b334-9d7f0d0f9ec9-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:58 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6ef008bb-2398-4c03-8454-18efb7fe4c59 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "cinder-b280d5fb-8453-4508-ba9a-8f037555bcf3-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:58 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6ef008bb-2398-4c03-8454-18efb7fe4c59 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-b280d5fb-8453-4508-ba9a-8f037555bcf3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:58 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6ef008bb-2398-4c03-8454-18efb7fe4c59 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "cinder-quobyte-b280d5fb-8453-4508-ba9a-8f037555bcf3" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:58 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6ef008bb-2398-4c03-8454-18efb7fe4c59 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-quobyte-b280d5fb-8453-4508-ba9a-8f037555bcf3" acquired by "delete_volume" :: waited 0.015s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:04:58 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5de739-4f14-454c-855a-44d3ac11afff]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:04:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6ef008bb-2398-4c03-8454-18efb7fe4c59 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b280d5fb-8453-4508-ba9a-8f037555bcf3 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:58 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b280d5fb-8453-4508-ba9a-8f037555bcf3 Sep 04 16:04:58 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:59 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6ef008bb-2398-4c03-8454-18efb7fe4c59 tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b280d5fb-8453-4508-ba9a-8f037555bcf3" returned: 0 in 0.381s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6ef008bb-2398-4c03-8454-18efb7fe4c59 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b280d5fb-8453-4508-ba9a-8f037555bcf3 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:59 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b280d5fb-8453-4508-ba9a-8f037555bcf3 Sep 04 16:04:59 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:59 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6ef008bb-2398-4c03-8454-18efb7fe4c59 tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b280d5fb-8453-4508-ba9a-8f037555bcf3" returned: 0 in 0.265s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:59 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6ef008bb-2398-4c03-8454-18efb7fe4c59 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-quobyte-b280d5fb-8453-4508-ba9a-8f037555bcf3" released by "delete_volume" :: held 0.687s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:59 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-6ef008bb-2398-4c03-8454-18efb7fe4c59 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Created reservations ['4e362569-7745-4349-b097-a2697e9c69f7', 'a56fdb7c-96a8-49ad-b271-7f868f645aa5', '4fd527e5-c4fb-4f22-9c6b-7875dd29fd62', '92b26515-6c5c-444f-b6d3-82a416b0f5f0'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:04:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6ef008bb-2398-4c03-8454-18efb7fe4c59 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:04:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6ef008bb-2398-4c03-8454-18efb7fe4c59 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:04:59 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-6ef008bb-2398-4c03-8454-18efb7fe4c59 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:04:59 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-6ef008bb-2398-4c03-8454-18efb7fe4c59 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:04:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6ef008bb-2398-4c03-8454-18efb7fe4c59 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:04:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6ef008bb-2398-4c03-8454-18efb7fe4c59 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:04:59 devstack sudo[104425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:04:59 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:04:59 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root Sep 04 16:04:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6ef008bb-2398-4c03-8454-18efb7fe4c59 tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.256s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:04:59 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-6ef008bb-2398-4c03-8454-18efb7fe4c59 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:04:59 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-6ef008bb-2398-4c03-8454-18efb7fe4c59 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Deleted volume successfully. Sep 04 16:04:59 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6ef008bb-2398-4c03-8454-18efb7fe4c59 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-b280d5fb-8453-4508-ba9a-8f037555bcf3-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:04:59 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-50e91bb2-72e6-4c61-a700-cad39a3015bb tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "cinder-6d5055f2-7d9e-451c-b160-21921763c9ff-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:04:59 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-50e91bb2-72e6-4c61-a700-cad39a3015bb tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-6d5055f2-7d9e-451c-b160-21921763c9ff-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-50e91bb2-72e6-4c61-a700-cad39a3015bb tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "cinder-quobyte-6d5055f2-7d9e-451c-b160-21921763c9ff" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-50e91bb2-72e6-4c61-a700-cad39a3015bb tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-quobyte-6d5055f2-7d9e-451c-b160-21921763c9ff" acquired by "delete_volume" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:00 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bfa93f-ac07-4405-9352-8991f903048a]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-50e91bb2-72e6-4c61-a700-cad39a3015bb tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6d5055f2-7d9e-451c-b160-21921763c9ff {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:00 devstack sudo[104428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6d5055f2-7d9e-451c-b160-21921763c9ff Sep 04 16:05:00 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:00 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-50e91bb2-72e6-4c61-a700-cad39a3015bb tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6d5055f2-7d9e-451c-b160-21921763c9ff" returned: 0 in 0.390s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-50e91bb2-72e6-4c61-a700-cad39a3015bb tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6d5055f2-7d9e-451c-b160-21921763c9ff {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:00 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6d5055f2-7d9e-451c-b160-21921763c9ff Sep 04 16:05:00 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:00 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-50e91bb2-72e6-4c61-a700-cad39a3015bb tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6d5055f2-7d9e-451c-b160-21921763c9ff" returned: 0 in 0.242s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-50e91bb2-72e6-4c61-a700-cad39a3015bb tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-quobyte-6d5055f2-7d9e-451c-b160-21921763c9ff" released by "delete_volume" :: held 0.679s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:00 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-50e91bb2-72e6-4c61-a700-cad39a3015bb tempest-CreateVolumesFromSnapshotTest-1270674288 None] Created reservations ['24ab1d78-b4f1-4926-9be2-2049f508f173', 'e24e8f45-53f6-4404-8cb6-3876202b86a2', '93745ab9-7c56-4367-98c0-a36cd549a18e', 'ac4ef2a2-8c44-46a5-bcf2-ced9efd6d885'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:05:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-50e91bb2-72e6-4c61-a700-cad39a3015bb tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-50e91bb2-72e6-4c61-a700-cad39a3015bb tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:00 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-50e91bb2-72e6-4c61-a700-cad39a3015bb tempest-CreateVolumesFromSnapshotTest-1270674288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:05:00 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-50e91bb2-72e6-4c61-a700-cad39a3015bb tempest-CreateVolumesFromSnapshotTest-1270674288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:05:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-50e91bb2-72e6-4c61-a700-cad39a3015bb tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-50e91bb2-72e6-4c61-a700-cad39a3015bb tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:00 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:05:00 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:01 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-50e91bb2-72e6-4c61-a700-cad39a3015bb tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.266s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:01 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-50e91bb2-72e6-4c61-a700-cad39a3015bb tempest-CreateVolumesFromSnapshotTest-1270674288 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:05:01 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-50e91bb2-72e6-4c61-a700-cad39a3015bb tempest-CreateVolumesFromSnapshotTest-1270674288 None] Deleted volume successfully. Sep 04 16:05:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c6e4fadb-6e5f-400a-97d0-547e1f7748fa tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "cinder-b9ce1c62-3133-40ce-b8a4-3ba872307caa-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-50e91bb2-72e6-4c61-a700-cad39a3015bb tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-6d5055f2-7d9e-451c-b160-21921763c9ff-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c6e4fadb-6e5f-400a-97d0-547e1f7748fa tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-b9ce1c62-3133-40ce-b8a4-3ba872307caa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c6e4fadb-6e5f-400a-97d0-547e1f7748fa tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "cinder-quobyte-b9ce1c62-3133-40ce-b8a4-3ba872307caa" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c6e4fadb-6e5f-400a-97d0-547e1f7748fa tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-quobyte-b9ce1c62-3133-40ce-b8a4-3ba872307caa" acquired by "delete_volume" :: waited 0.015s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:01 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[657c30b1-a208-44da-805a-0ff26c1a6dc1]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c6e4fadb-6e5f-400a-97d0-547e1f7748fa tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b9ce1c62-3133-40ce-b8a4-3ba872307caa {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:01 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b9ce1c62-3133-40ce-b8a4-3ba872307caa Sep 04 16:05:01 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:01 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c6e4fadb-6e5f-400a-97d0-547e1f7748fa tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b9ce1c62-3133-40ce-b8a4-3ba872307caa" returned: 0 in 0.370s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c6e4fadb-6e5f-400a-97d0-547e1f7748fa tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b9ce1c62-3133-40ce-b8a4-3ba872307caa {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:01 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b9ce1c62-3133-40ce-b8a4-3ba872307caa Sep 04 16:05:01 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:01 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c6e4fadb-6e5f-400a-97d0-547e1f7748fa tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b9ce1c62-3133-40ce-b8a4-3ba872307caa" returned: 0 in 0.263s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c6e4fadb-6e5f-400a-97d0-547e1f7748fa tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-quobyte-b9ce1c62-3133-40ce-b8a4-3ba872307caa" released by "delete_volume" :: held 0.676s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:01 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-c6e4fadb-6e5f-400a-97d0-547e1f7748fa tempest-CreateVolumesFromSnapshotTest-1270674288 None] Created reservations ['7b6ca8d9-298a-4d08-ab0a-ab52c1718bb7', 'ef62d260-cda7-43b5-a71b-2ec41f94a118', 'f63c6594-0053-41b2-8174-8d4966f41283', '58b452d9-7ab2-4ec0-ab4f-8acbecab855d'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:05:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c6e4fadb-6e5f-400a-97d0-547e1f7748fa tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c6e4fadb-6e5f-400a-97d0-547e1f7748fa tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:02 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c6e4fadb-6e5f-400a-97d0-547e1f7748fa tempest-CreateVolumesFromSnapshotTest-1270674288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:05:02 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c6e4fadb-6e5f-400a-97d0-547e1f7748fa tempest-CreateVolumesFromSnapshotTest-1270674288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:05:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c6e4fadb-6e5f-400a-97d0-547e1f7748fa tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c6e4fadb-6e5f-400a-97d0-547e1f7748fa tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:02 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:05:02 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:02 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c6e4fadb-6e5f-400a-97d0-547e1f7748fa tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.267s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:02 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-c6e4fadb-6e5f-400a-97d0-547e1f7748fa tempest-CreateVolumesFromSnapshotTest-1270674288 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:05:02 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-099cc45b-d46c-4bf4-a57a-a37b76fb6f4d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "cinder-a6385b92-078f-4ef4-9ca1-4f0d50fe6aec-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:02 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-c6e4fadb-6e5f-400a-97d0-547e1f7748fa tempest-CreateVolumesFromSnapshotTest-1270674288 None] Deleted volume successfully. Sep 04 16:05:02 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-099cc45b-d46c-4bf4-a57a-a37b76fb6f4d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-a6385b92-078f-4ef4-9ca1-4f0d50fe6aec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:02 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-099cc45b-d46c-4bf4-a57a-a37b76fb6f4d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "cinder-quobyte-9241b186-cfb7-4fbf-994c-40afd4e7bfb5" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:02 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c6e4fadb-6e5f-400a-97d0-547e1f7748fa tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-b9ce1c62-3133-40ce-b8a4-3ba872307caa-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:02 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-099cc45b-d46c-4bf4-a57a-a37b76fb6f4d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-quobyte-9241b186-cfb7-4fbf-994c-40afd4e7bfb5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:02 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-099cc45b-d46c-4bf4-a57a-a37b76fb6f4d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "cinder-quobyte-a6385b92-078f-4ef4-9ca1-4f0d50fe6aec" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:02 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-099cc45b-d46c-4bf4-a57a-a37b76fb6f4d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-quobyte-a6385b92-078f-4ef4-9ca1-4f0d50fe6aec" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:02 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-099cc45b-d46c-4bf4-a57a-a37b76fb6f4d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Deleting offline snapshot a6385b92-078f-4ef4-9ca1-4f0d50fe6aec of volume 9241b186-cfb7-4fbf-994c-40afd4e7bfb5 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:05:02 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-099cc45b-d46c-4bf4-a57a-a37b76fb6f4d tempest-CreateVolumesFromSnapshotTest-1270674288 None] snapshot_file for this snap is: volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5.a6385b92-078f-4ef4-9ca1-4f0d50fe6aec {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:05:02 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb04ecff-5c58-4d1e-b751-75063028e79d]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-099cc45b-d46c-4bf4-a57a-a37b76fb6f4d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5.a6385b92-078f-4ef4-9ca1-4f0d50fe6aec {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:02 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5.a6385b92-078f-4ef4-9ca1-4f0d50fe6aec Sep 04 16:05:02 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:02 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-099cc45b-d46c-4bf4-a57a-a37b76fb6f4d tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5.a6385b92-078f-4ef4-9ca1-4f0d50fe6aec" returned: 0 in 0.365s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:02 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-099cc45b-d46c-4bf4-a57a-a37b76fb6f4d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:05:02 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d7fe14-cd0e-46a1-9c4c-a064765486d5]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-099cc45b-d46c-4bf4-a57a-a37b76fb6f4d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:02 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5 Sep 04 16:05:02 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:03 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-099cc45b-d46c-4bf4-a57a-a37b76fb6f4d tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5" returned: 0 in 0.379s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-099cc45b-d46c-4bf4-a57a-a37b76fb6f4d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5.a6385b92-078f-4ef4-9ca1-4f0d50fe6aec {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:03 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5.a6385b92-078f-4ef4-9ca1-4f0d50fe6aec Sep 04 16:05:03 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:03 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-099cc45b-d46c-4bf4-a57a-a37b76fb6f4d tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5.a6385b92-078f-4ef4-9ca1-4f0d50fe6aec" returned: 0 in 0.358s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-099cc45b-d46c-4bf4-a57a-a37b76fb6f4d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5.a6385b92-078f-4ef4-9ca1-4f0d50fe6aec {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:03 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5.a6385b92-078f-4ef4-9ca1-4f0d50fe6aec Sep 04 16:05:03 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:03 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:05:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Flow 'volume_create_manager' (1c737771-bf69-49bd-b5d8-2f03f72f16c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2acd3c5-0f88-4f98-80aa-77825a4df29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2acd3c5-0f88-4f98-80aa-77825a4df29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fedbea24-5f80-47f3-8578-18ec150100cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='866d0d77903747dd9074b9034a8d95c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:04Z,use_quota=True,user_id='68e7242d96974dfb86bd47acf9ce4c0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db824643-eb28-4914-aa79-369a45c11bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db824643-eb28-4914-aa79-369a45c11bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:03 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cc9682-b8a3-4f8d-830f-a9a3da80f784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:03 devstack cinder-volume[87490]: DEBUG cinder.image.glance [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Creating Keystone auth plugin from conf {{(pid=87490) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 16:05:03 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-099cc45b-d46c-4bf4-a57a-a37b76fb6f4d tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5.a6385b92-078f-4ef4-9ca1-4f0d50fe6aec" returned: 0 in 0.244s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-099cc45b-d46c-4bf4-a57a-a37b76fb6f4d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-quobyte-a6385b92-078f-4ef4-9ca1-4f0d50fe6aec" released by "_delete_snapshot" :: held 1.451s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-099cc45b-d46c-4bf4-a57a-a37b76fb6f4d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-quobyte-9241b186-cfb7-4fbf-994c-40afd4e7bfb5" released by "delete_snapshot" :: held 1.473s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:03 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-099cc45b-d46c-4bf4-a57a-a37b76fb6f4d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Created reservations ['36d29840-500d-4080-a570-0dda36fc8b9f', 'ef05018f-ad26-4492-a61a-babdd95b6040', '8ba057c4-1e2f-4df0-82cd-70a3ef24a7ad', '6cfae8ea-c6f0-456f-9600-c1d0d471904e'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:05:03 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-099cc45b-d46c-4bf4-a57a-a37b76fb6f4d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Delete snapshot completed successfully. Sep 04 16:05:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-099cc45b-d46c-4bf4-a57a-a37b76fb6f4d tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-a6385b92-078f-4ef4-9ca1-4f0d50fe6aec-delete_snapshot" released by "delete_snapshot" :: held 1.610s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cc9682-b8a3-4f8d-830f-a9a3da80f784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fedbea24-5f80-47f3-8578-18ec150100cf', 'volume_name': 'volume-fedbea24-5f80-47f3-8578-18ec150100cf', 'volume_size': 1, 'image_id': '7e616cb8-c341-42ee-9167-514ffa6c057f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7e616cb8-c341-42ee-9167-514ffa6c057f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4dc243ce72daa3083784452fb938378f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '866d0d77903747dd9074b9034a8d95c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ed8ca6822f695ad1566d6be23b12d5c776cd5bbf81a340f589125c812f9dad27180c9a40c57941d18398958aa02eb06a03503928973b8f95fceda7342509ac6e', 'id': '7e616cb8-c341-42ee-9167-514ffa6c057f', 'created_at': datetime.datetime(2026, 9, 4, 14, 5, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 5, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7e616cb8-c341-42ee-9167-514ffa6c057f/file', 'properties': {}}, 'image_service': }' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f149a7d3-6a51-4b47-a014-5ae38a4a9fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f149a7d3-6a51-4b47-a014-5ae38a4a9fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a2a56f8-f6e5-467b-a92d-347cf5cbe30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:04 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Volume fedbea24-5f80-47f3-8578-18ec150100cf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fedbea24-5f80-47f3-8578-18ec150100cf', 'volume_size': 1, 'image_id': '7e616cb8-c341-42ee-9167-514ffa6c057f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7e616cb8-c341-42ee-9167-514ffa6c057f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4dc243ce72daa3083784452fb938378f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '866d0d77903747dd9074b9034a8d95c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ed8ca6822f695ad1566d6be23b12d5c776cd5bbf81a340f589125c812f9dad27180c9a40c57941d18398958aa02eb06a03503928973b8f95fceda7342509ac6e', 'id': '7e616cb8-c341-42ee-9167-514ffa6c057f', 'created_at': datetime.datetime(2026, 9, 4, 14, 5, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 5, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7e616cb8-c341-42ee-9167-514ffa6c057f/file', 'properties': {}}, 'image_service': } Sep 04 16:05:04 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Trying to clone fedbea24-5f80-47f3-8578-18ec150100cf from image 7e616cb8-c341-42ee-9167-514ffa6c057f at location (None, [{'url': 'file:///opt/stack/data/glance/images/7e616cb8-c341-42ee-9167-514ffa6c057f', 'metadata': {}}]). {{(pid=87490) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 16:05:04 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7e616cb8-c341-42ee-9167-514ffa6c057f_c0930_l0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 16:05:04 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Image download 0.00 MB at 0.00 MB/s Sep 04 16:05:04 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a50cea6-d8a3-470a-92cd-1261f68f1818]: (4, 'raw') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e616cb8-c341-42ee-9167-514ffa6c057f_c0930_l0devstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:04 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e616cb8-c341-42ee-9167-514ffa6c057f_c0930_l0devstack@QuobyteHD Sep 04 16:05:04 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:04 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:04 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-135d9236-29cd-4214-9cb6-3e604d9d7fb9 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "cinder-9241b186-cfb7-4fbf-994c-40afd4e7bfb5-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e616cb8-c341-42ee-9167-514ffa6c057f_c0930_l0devstack@QuobyteHD" returned: 0 in 0.350s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e616cb8-c341-42ee-9167-514ffa6c057f_c0930_l0devstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:04 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-135d9236-29cd-4214-9cb6-3e604d9d7fb9 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-9241b186-cfb7-4fbf-994c-40afd4e7bfb5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:04 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-135d9236-29cd-4214-9cb6-3e604d9d7fb9 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "cinder-quobyte-9241b186-cfb7-4fbf-994c-40afd4e7bfb5" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:04 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-135d9236-29cd-4214-9cb6-3e604d9d7fb9 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-quobyte-9241b186-cfb7-4fbf-994c-40afd4e7bfb5" acquired by "delete_volume" :: waited 0.014s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:04 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d853fb0-9004-422d-84d2-2f6869907888]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:04 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e616cb8-c341-42ee-9167-514ffa6c057f_c0930_l0devstack@QuobyteHD Sep 04 16:05:04 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-135d9236-29cd-4214-9cb6-3e604d9d7fb9 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:04 devstack sudo[104477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5 Sep 04 16:05:04 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:04 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e616cb8-c341-42ee-9167-514ffa6c057f_c0930_l0devstack@QuobyteHD" returned: 1 in 0.349s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e616cb8-c341-42ee-9167-514ffa6c057f_c0930_l0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:05:04 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Temporary image 7e616cb8-c341-42ee-9167-514ffa6c057f is fetched for user 68e7242d96974dfb86bd47acf9ce4c0a. {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 16:05:04 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e50d98-91a9-4724-8f7a-7894208d7d01]: (4, 'raw') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e616cb8-c341-42ee-9167-514ffa6c057f_c0930_l0devstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:05 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e616cb8-c341-42ee-9167-514ffa6c057f_c0930_l0devstack@QuobyteHD Sep 04 16:05:05 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:05 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-135d9236-29cd-4214-9cb6-3e604d9d7fb9 tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5" returned: 0 in 0.403s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-135d9236-29cd-4214-9cb6-3e604d9d7fb9 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:05 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5 Sep 04 16:05:05 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:05 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e616cb8-c341-42ee-9167-514ffa6c057f_c0930_l0devstack@QuobyteHD" returned: 0 in 0.331s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e616cb8-c341-42ee-9167-514ffa6c057f_c0930_l0devstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:05 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-135d9236-29cd-4214-9cb6-3e604d9d7fb9 tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-9241b186-cfb7-4fbf-994c-40afd4e7bfb5" returned: 0 in 0.257s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-135d9236-29cd-4214-9cb6-3e604d9d7fb9 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-quobyte-9241b186-cfb7-4fbf-994c-40afd4e7bfb5" released by "delete_volume" :: held 0.719s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-135d9236-29cd-4214-9cb6-3e604d9d7fb9 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Created reservations ['425741ba-8b35-46b0-9687-38e0bb0c8c40', 'f64ccbd7-b7ad-44d7-86ee-97f8e93a20e0', 'b334c5dc-7ae4-47b5-904c-9a92c402a1a7', 'cb1b4259-fc56-4259-b5d1-a1555fb9deeb'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:05:05 devstack sudo[104492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e616cb8-c341-42ee-9167-514ffa6c057f_c0930_l0devstack@QuobyteHD Sep 04 16:05:05 devstack sudo[104492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-135d9236-29cd-4214-9cb6-3e604d9d7fb9 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-135d9236-29cd-4214-9cb6-3e604d9d7fb9 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-135d9236-29cd-4214-9cb6-3e604d9d7fb9 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-135d9236-29cd-4214-9cb6-3e604d9d7fb9 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-135d9236-29cd-4214-9cb6-3e604d9d7fb9 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-135d9236-29cd-4214-9cb6-3e604d9d7fb9 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:05 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:05:05 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:05 devstack sudo[104492]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e616cb8-c341-42ee-9167-514ffa6c057f_c0930_l0devstack@QuobyteHD" returned: 1 in 0.359s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e616cb8-c341-42ee-9167-514ffa6c057f_c0930_l0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fedbea24-5f80-47f3-8578-18ec150100cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='866d0d77903747dd9074b9034a8d95c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:04Z,use_quota=True,user_id='68e7242d96974dfb86bd47acf9ce4c0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Creating volume fedbea24-5f80-47f3-8578-18ec150100cf {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:05:05 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fedbea24-5f80-47f3-8578-18ec150100cf 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:05 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fedbea24-5f80-47f3-8578-18ec150100cf 1073741824 Sep 04 16:05:05 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:05 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-135d9236-29cd-4214-9cb6-3e604d9d7fb9 tempest-CreateVolumesFromSnapshotTest-1270674288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.276s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-135d9236-29cd-4214-9cb6-3e604d9d7fb9 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:05:05 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-135d9236-29cd-4214-9cb6-3e604d9d7fb9 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Deleted volume successfully. Sep 04 16:05:05 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-135d9236-29cd-4214-9cb6-3e604d9d7fb9 tempest-CreateVolumesFromSnapshotTest-1270674288 None] Lock "cinder-9241b186-cfb7-4fbf-994c-40afd4e7bfb5-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:06 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fedbea24-5f80-47f3-8578-18ec150100cf 1073741824" returned: 0 in 0.458s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fedbea24-5f80-47f3-8578-18ec150100cf {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:06 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fedbea24-5f80-47f3-8578-18ec150100cf Sep 04 16:05:06 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:06 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fedbea24-5f80-47f3-8578-18ec150100cf" returned: 0 in 0.279s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:06 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:05:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:06 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Attempting download of 7e616cb8-c341-42ee-9167-514ffa6c057f ((None, [{'url': 'file:///opt/stack/data/glance/images/7e616cb8-c341-42ee-9167-514ffa6c057f', 'metadata': {}}])) to volume fedbea24-5f80-47f3-8578-18ec150100cf. {{(pid=87490) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 16:05:06 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bafca3-d7a7-43c2-995e-5c0f6075a709]: (4, 'raw') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7e616cb8-c341-42ee-9167-514ffa6c057f_u9bif5ce {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:06 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7e616cb8-c341-42ee-9167-514ffa6c057f_u9bif5ce Sep 04 16:05:06 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:06 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7e616cb8-c341-42ee-9167-514ffa6c057f_u9bif5ce" returned: 0 in 0.350s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e616cb8-c341-42ee-9167-514ffa6c057f_u9bif5ce {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:06 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e616cb8-c341-42ee-9167-514ffa6c057f_u9bif5ce Sep 04 16:05:06 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:07 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e616cb8-c341-42ee-9167-514ffa6c057f_u9bif5ce" returned: 1 in 0.347s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e616cb8-c341-42ee-9167-514ffa6c057f_u9bif5ce' failed. Not Retrying. {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:05:07 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[087b0f90-65ee-482c-8f24-d0fddae5878e]: (4, 'raw') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e616cb8-c341-42ee-9167-514ffa6c057f_c0930_l0devstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:07 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e616cb8-c341-42ee-9167-514ffa6c057f_c0930_l0devstack@QuobyteHD Sep 04 16:05:07 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:07 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e616cb8-c341-42ee-9167-514ffa6c057f_c0930_l0devstack@QuobyteHD" returned: 0 in 0.373s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e616cb8-c341-42ee-9167-514ffa6c057f_c0930_l0devstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:07 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e616cb8-c341-42ee-9167-514ffa6c057f_c0930_l0devstack@QuobyteHD Sep 04 16:05:07 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:07 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e616cb8-c341-42ee-9167-514ffa6c057f_c0930_l0devstack@QuobyteHD" returned: 1 in 0.341s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e616cb8-c341-42ee-9167-514ffa6c057f_c0930_l0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:05:07 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] 7e616cb8-c341-42ee-9167-514ffa6c057f was raw, converting to qcow2 {{(pid=87490) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 16:05:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7e616cb8-c341-42ee-9167-514ffa6c057f_c0930_l0devstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fedbea24-5f80-47f3-8578-18ec150100cf {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:07 devstack sudo[104527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7e616cb8-c341-42ee-9167-514ffa6c057f_c0930_l0devstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fedbea24-5f80-47f3-8578-18ec150100cf Sep 04 16:05:07 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:08 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7e616cb8-c341-42ee-9167-514ffa6c057f_c0930_l0devstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fedbea24-5f80-47f3-8578-18ec150100cf" returned: 0 in 0.457s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7e616cb8-c341-42ee-9167-514ffa6c057f_c0930_l0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fedbea24-5f80-47f3-8578-18ec150100cf {{(pid=87490) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 16:05:08 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Converted 0.00 MB image at 0.00 MB/s Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fedbea24-5f80-47f3-8578-18ec150100cf 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:08 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fedbea24-5f80-47f3-8578-18ec150100cf 1G Sep 04 16:05:08 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:08 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fedbea24-5f80-47f3-8578-18ec150100cf 1G" returned: 0 in 0.323s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Downloaded image 7e616cb8-c341-42ee-9167-514ffa6c057f ((None, [{'url': 'file:///opt/stack/data/glance/images/7e616cb8-c341-42ee-9167-514ffa6c057f', 'metadata': {}}])) to volume fedbea24-5f80-47f3-8578-18ec150100cf successfully. {{(pid=87490) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Temporary image 7e616cb8-c341-42ee-9167-514ffa6c057f for user 68e7242d96974dfb86bd47acf9ce4c0a is deleted. {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Marking volume fedbea24-5f80-47f3-8578-18ec150100cf as bootable. {{(pid=87490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Copying metadata from image 7e616cb8-c341-42ee-9167-514ffa6c057f to fedbea24-5f80-47f3-8578-18ec150100cf. {{(pid=87490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Creating volume glance metadata for volume fedbea24-5f80-47f3-8578-18ec150100cf backed by image 7e616cb8-c341-42ee-9167-514ffa6c057f with: {'image_id': '7e616cb8-c341-42ee-9167-514ffa6c057f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4dc243ce72daa3083784452fb938378f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87490) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a2a56f8-f6e5-467b-a92d-347cf5cbe30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fedbea24-5f80-47f3-8578-18ec150100cf', 'volume_size': 1, 'image_id': '7e616cb8-c341-42ee-9167-514ffa6c057f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7e616cb8-c341-42ee-9167-514ffa6c057f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4dc243ce72daa3083784452fb938378f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '866d0d77903747dd9074b9034a8d95c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ed8ca6822f695ad1566d6be23b12d5c776cd5bbf81a340f589125c812f9dad27180c9a40c57941d18398958aa02eb06a03503928973b8f95fceda7342509ac6e', 'id': '7e616cb8-c341-42ee-9167-514ffa6c057f', 'created_at': datetime.datetime(2026, 9, 4, 14, 5, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 5, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7e616cb8-c341-42ee-9167-514ffa6c057f/file', 'properties': {}}, 'image_service': }' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50489f13-9880-4af8-a4b8-321ae93dbe57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:08 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Volume volume-fedbea24-5f80-47f3-8578-18ec150100cf (fedbea24-5f80-47f3-8578-18ec150100cf): created successfully Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50489f13-9880-4af8-a4b8-321ae93dbe57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Flow 'volume_create_manager' (1c737771-bf69-49bd-b5d8-2f03f72f16c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:08 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-91ad14ce-a1e3-4920-a374-df718368ad2c tempest-VolumeImageDependencyTests-806043821 None] Created volume successfully. Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Flow 'volume_create_manager' (8b2ff7a9-97db-4125-bc08-30a13b716946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dace1f58-bd16-4ef9-81f3-3d182ba511a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dace1f58-bd16-4ef9-81f3-3d182ba511a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-880673415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ae572e-0e1a-423b-8df5-5341be07ec6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c160364b07249be991d9e5f1cf53cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:09Z,use_quota=True,user_id='bd8c6387022743e7a4f7025ca729c8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (675ff8de-7450-4b09-998c-4a6c43e9aff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (675ff8de-7450-4b09-998c-4a6c43e9aff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1e14631-3343-4484-9a1f-e36157ff8c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1e14631-3343-4484-9a1f-e36157ff8c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15ae572e-0e1a-423b-8df5-5341be07ec6d', 'volume_name': 'volume-15ae572e-0e1a-423b-8df5-5341be07ec6d', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ec7d83-6dee-424a-beb9-8512b12e69a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ec7d83-6dee-424a-beb9-8512b12e69a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7ef654-fae3-4a0b-b178-5b79184fde09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:08 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Volume 15ae572e-0e1a-423b-8df5-5341be07ec6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15ae572e-0e1a-423b-8df5-5341be07ec6d', 'volume_size': 1} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-880673415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ae572e-0e1a-423b-8df5-5341be07ec6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c160364b07249be991d9e5f1cf53cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:09Z,use_quota=True,user_id='bd8c6387022743e7a4f7025ca729c8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Creating volume 15ae572e-0e1a-423b-8df5-5341be07ec6d {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:05:08 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:05:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:08 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d 1073741824 Sep 04 16:05:08 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:09 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d 1073741824" returned: 0 in 0.417s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:09 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d Sep 04 16:05:09 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:09 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d" returned: 0 in 0.227s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:09 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:05:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:09 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7ef654-fae3-4a0b-b178-5b79184fde09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ae572e-0e1a-423b-8df5-5341be07ec6d', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:09 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a581f2f-fcc3-49b2-af0c-2233af88311b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:09 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Volume volume-15ae572e-0e1a-423b-8df5-5341be07ec6d (15ae572e-0e1a-423b-8df5-5341be07ec6d): created successfully Sep 04 16:05:09 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a581f2f-fcc3-49b2-af0c-2233af88311b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:09 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Flow 'volume_create_manager' (8b2ff7a9-97db-4125-bc08-30a13b716946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:09 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-0aaad6fb-7692-4a79-a479-f129b46e0eee tempest-VolumeDependencyTests-452966670 None] Created volume successfully. Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=147,cinder:UPDATE=183,cinder:INSERT=50,cinder:DELETE=9 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=141,cinder:UPDATE=173,cinder:INSERT=41,cinder:DELETE=20 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f0d245b0-722a-45d7-a508-7e7d33f7f7e4 tempest-VolumeDependencyTests-452966670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f0d245b0-722a-45d7-a508-7e7d33f7f7e4 tempest-VolumeDependencyTests-452966670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-f0d245b0-722a-45d7-a508-7e7d33f7f7e4 tempest-VolumeDependencyTests-452966670 None] Creating offline snapshot fa472c86-1b91-4f98-bad6-4f24e8d0c83a of volume 15ae572e-0e1a-423b-8df5-5341be07ec6d {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-13e1ca17-fc1e-44ca-8647-6fb919d4ed24 tempest-VolumeImageDependencyTests-806043821 None] Acquiring lock "cinder-fedbea24-5f80-47f3-8578-18ec150100cf-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-13e1ca17-fc1e-44ca-8647-6fb919d4ed24 tempest-VolumeImageDependencyTests-806043821 None] Lock "cinder-fedbea24-5f80-47f3-8578-18ec150100cf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ceb381-ce43-4b09-a523-6d141d54d916]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f0d245b0-722a-45d7-a508-7e7d33f7f7e4 tempest-VolumeDependencyTests-452966670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-13e1ca17-fc1e-44ca-8647-6fb919d4ed24 tempest-VolumeImageDependencyTests-806043821 None] Acquiring lock "cinder-quobyte-fedbea24-5f80-47f3-8578-18ec150100cf" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-13e1ca17-fc1e-44ca-8647-6fb919d4ed24 tempest-VolumeImageDependencyTests-806043821 None] Lock "cinder-quobyte-fedbea24-5f80-47f3-8578-18ec150100cf" acquired by "delete_volume" :: waited 0.016s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d24c95-a23d-4f9f-aedb-4938a7758bc9]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-13e1ca17-fc1e-44ca-8647-6fb919d4ed24 tempest-VolumeImageDependencyTests-806043821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fedbea24-5f80-47f3-8578-18ec150100cf {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:10 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d Sep 04 16:05:10 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:10 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fedbea24-5f80-47f3-8578-18ec150100cf Sep 04 16:05:10 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:10 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f0d245b0-722a-45d7-a508-7e7d33f7f7e4 tempest-VolumeDependencyTests-452966670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d" returned: 0 in 0.365s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f0d245b0-722a-45d7-a508-7e7d33f7f7e4 tempest-VolumeDependencyTests-452966670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.fa472c86-1b91-4f98-bad6-4f24e8d0c83a 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:10 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.fa472c86-1b91-4f98-bad6-4f24e8d0c83a 1G Sep 04 16:05:10 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:10 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-13e1ca17-fc1e-44ca-8647-6fb919d4ed24 tempest-VolumeImageDependencyTests-806043821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fedbea24-5f80-47f3-8578-18ec150100cf" returned: 0 in 0.348s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-13e1ca17-fc1e-44ca-8647-6fb919d4ed24 tempest-VolumeImageDependencyTests-806043821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fedbea24-5f80-47f3-8578-18ec150100cf {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:10 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fedbea24-5f80-47f3-8578-18ec150100cf Sep 04 16:05:10 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:10 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-13e1ca17-fc1e-44ca-8647-6fb919d4ed24 tempest-VolumeImageDependencyTests-806043821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fedbea24-5f80-47f3-8578-18ec150100cf" returned: 0 in 0.232s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-13e1ca17-fc1e-44ca-8647-6fb919d4ed24 tempest-VolumeImageDependencyTests-806043821 None] Lock "cinder-quobyte-fedbea24-5f80-47f3-8578-18ec150100cf" released by "delete_volume" :: held 0.619s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-13e1ca17-fc1e-44ca-8647-6fb919d4ed24 tempest-VolumeImageDependencyTests-806043821 None] Created reservations ['7f2ee198-6f56-41b1-a45a-a93d4e46126f', '4f739451-5024-4f07-a120-8b57a395272e', 'a82c0d69-0a41-41de-856d-3c3ebeb9f592', '67e6d91a-a87f-4a35-886e-330688820474'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:05:10 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f0d245b0-722a-45d7-a508-7e7d33f7f7e4 tempest-VolumeDependencyTests-452966670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.fa472c86-1b91-4f98-bad6-4f24e8d0c83a 1G" returned: 0 in 0.408s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f0d245b0-722a-45d7-a508-7e7d33f7f7e4 tempest-VolumeDependencyTests-452966670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15ae572e-0e1a-423b-8df5-5341be07ec6d -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.fa472c86-1b91-4f98-bad6-4f24e8d0c83a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-13e1ca17-fc1e-44ca-8647-6fb919d4ed24 tempest-VolumeImageDependencyTests-806043821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-13e1ca17-fc1e-44ca-8647-6fb919d4ed24 tempest-VolumeImageDependencyTests-806043821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-13e1ca17-fc1e-44ca-8647-6fb919d4ed24 tempest-VolumeImageDependencyTests-806043821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:05:10 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15ae572e-0e1a-423b-8df5-5341be07ec6d -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.fa472c86-1b91-4f98-bad6-4f24e8d0c83a Sep 04 16:05:10 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-13e1ca17-fc1e-44ca-8647-6fb919d4ed24 tempest-VolumeImageDependencyTests-806043821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-13e1ca17-fc1e-44ca-8647-6fb919d4ed24 tempest-VolumeImageDependencyTests-806043821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-13e1ca17-fc1e-44ca-8647-6fb919d4ed24 tempest-VolumeImageDependencyTests-806043821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:10 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:05:10 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:11 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-13e1ca17-fc1e-44ca-8647-6fb919d4ed24 tempest-VolumeImageDependencyTests-806043821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.255s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:11 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-13e1ca17-fc1e-44ca-8647-6fb919d4ed24 tempest-VolumeImageDependencyTests-806043821 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:05:11 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-13e1ca17-fc1e-44ca-8647-6fb919d4ed24 tempest-VolumeImageDependencyTests-806043821 None] Deleted volume successfully. Sep 04 16:05:11 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-13e1ca17-fc1e-44ca-8647-6fb919d4ed24 tempest-VolumeImageDependencyTests-806043821 None] Lock "cinder-fedbea24-5f80-47f3-8578-18ec150100cf-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:11 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f0d245b0-722a-45d7-a508-7e7d33f7f7e4 tempest-VolumeDependencyTests-452966670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15ae572e-0e1a-423b-8df5-5341be07ec6d -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.fa472c86-1b91-4f98-bad6-4f24e8d0c83a" returned: 0 in 0.326s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:11 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-f0d245b0-722a-45d7-a508-7e7d33f7f7e4 tempest-VolumeDependencyTests-452966670 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.fa472c86-1b91-4f98-bad6-4f24e8d0c83a is being set with open permissions: ugo+rw Sep 04 16:05:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f0d245b0-722a-45d7-a508-7e7d33f7f7e4 tempest-VolumeDependencyTests-452966670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.fa472c86-1b91-4f98-bad6-4f24e8d0c83a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:11 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.fa472c86-1b91-4f98-bad6-4f24e8d0c83a Sep 04 16:05:11 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:11 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f0d245b0-722a-45d7-a508-7e7d33f7f7e4 tempest-VolumeDependencyTests-452966670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.fa472c86-1b91-4f98-bad6-4f24e8d0c83a" returned: 0 in 0.254s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f0d245b0-722a-45d7-a508-7e7d33f7f7e4 tempest-VolumeDependencyTests-452966670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:11 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.info Sep 04 16:05:11 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:11 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f0d245b0-722a-45d7-a508-7e7d33f7f7e4 tempest-VolumeDependencyTests-452966670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.info" returned: 0 in 0.252s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:11 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-f0d245b0-722a-45d7-a508-7e7d33f7f7e4 tempest-VolumeDependencyTests-452966670 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.info is being set with open permissions: ugo+rw Sep 04 16:05:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f0d245b0-722a-45d7-a508-7e7d33f7f7e4 tempest-VolumeDependencyTests-452966670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:11 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.info Sep 04 16:05:11 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:12 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f0d245b0-722a-45d7-a508-7e7d33f7f7e4 tempest-VolumeDependencyTests-452966670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.info" returned: 0 in 0.260s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f0d245b0-722a-45d7-a508-7e7d33f7f7e4 tempest-VolumeDependencyTests-452966670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.977s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:12 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-f0d245b0-722a-45d7-a508-7e7d33f7f7e4 tempest-VolumeDependencyTests-452966670 None] Create snapshot completed successfully Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Flow 'volume_create_manager' (efc0b3b6-745f-4e36-ae07-cb4610a1d299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19e57613-04d6-452c-9807-619a2a754a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19e57613-04d6-452c-9807-619a2a754a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-477926005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b710c18-260f-433a-80ca-cceede21980e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c160364b07249be991d9e5f1cf53cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fa472c86-1b91-4f98-bad6-4f24e8d0c83a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:13Z,use_quota=True,user_id='bd8c6387022743e7a4f7025ca729c8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d3b29e-70b5-4b0c-88cb-3ce634845164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d3b29e-70b5-4b0c-88cb-3ce634845164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b761b4-edb1-4020-b4a7-5fe80057b75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b761b4-edb1-4020-b4a7-5fe80057b75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2b710c18-260f-433a-80ca-cceede21980e', 'volume_name': 'volume-2b710c18-260f-433a-80ca-cceede21980e', 'volume_size': 1, 'snapshot_id': 'fa472c86-1b91-4f98-bad6-4f24e8d0c83a'}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e987eae-1e51-4fa7-ae13-bd9b6e1a036c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e987eae-1e51-4fa7-ae13-bd9b6e1a036c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab57cfac-d2df-4190-9294-8564bb120b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:12 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Volume 2b710c18-260f-433a-80ca-cceede21980e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2b710c18-260f-433a-80ca-cceede21980e', 'volume_size': 1, 'snapshot_id': 'fa472c86-1b91-4f98-bad6-4f24e8d0c83a'} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Acquiring lock "cinder-quobyte-fa472c86-1b91-4f98-bad6-4f24e8d0c83a-2b710c18-260f-433a-80ca-cceede21980e" by "_create_volume_from_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Lock "cinder-quobyte-fa472c86-1b91-4f98-bad6-4f24e8d0c83a-2b710c18-260f-433a-80ca-cceede21980e" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Creating volume 2b710c18-260f-433a-80ca-cceede21980e from snapshot fa472c86-1b91-4f98-bad6-4f24e8d0c83a {{(pid=87490) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Acquiring lock "cinder-quobyte-2b710c18-260f-433a-80ca-cceede21980e" by "_copy_volume_from_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Lock "cinder-quobyte-2b710c18-260f-433a-80ca-cceede21980e" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] snapshot: fa472c86-1b91-4f98-bad6-4f24e8d0c83a, volume: 2b710c18-260f-433a-80ca-cceede21980e, {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d119e75-6404-474a-810c-849ad4834f79]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.fa472c86-1b91-4f98-bad6-4f24e8d0c83a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:13 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.fa472c86-1b91-4f98-bad6-4f24e8d0c83a Sep 04 16:05:13 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:13 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.fa472c86-1b91-4f98-bad6-4f24e8d0c83a" returned: 0 in 0.365s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15ae572e-0e1a-423b-8df5-5341be07ec6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:05:13 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed68628b-870e-4c97-b13e-90ec8ca0c32f]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:13 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d Sep 04 16:05:13 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:13 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d" returned: 0 in 0.360s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 16:05:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Creating direct copy from snapshot {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 16:05:13 devstack cinder-volume[87490]: DEBUG cinder.utils [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Path /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2b710c18-260f-433a-80ca-cceede21980e not found in is_blk_device check {{(pid=87490) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 16:05:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2b710c18-260f-433a-80ca-cceede21980e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:13 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2b710c18-260f-433a-80ca-cceede21980e Sep 04 16:05:13 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:16 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:05:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Flow 'volume_create_manager' (8c3a0edc-6953-4e10-beea-fcc10c7b9576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6dcf80-5406-4c04-8c0b-daec5a69c782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6dcf80-5406-4c04-8c0b-daec5a69c782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-31573747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b47536e-a735-46a7-92e9-1cc8491ccd00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16a9d15f6ff44c0a90ab58b686c8bd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:17Z,use_quota=True,user_id='435d8808fadf46aea537a8d62eaa4aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e958b840-7174-4de5-9378-53f9dff4097e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e958b840-7174-4de5-9378-53f9dff4097e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5097525-8618-4a45-8ddf-b33305adbcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5097525-8618-4a45-8ddf-b33305adbcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b47536e-a735-46a7-92e9-1cc8491ccd00', 'volume_name': 'volume-7b47536e-a735-46a7-92e9-1cc8491ccd00', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3782836a-af09-403a-aa28-81d6d3d8d62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3782836a-af09-403a-aa28-81d6d3d8d62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c785a5-5893-4f17-bc9b-98c4bf2ae6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:17 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Volume 7b47536e-a735-46a7-92e9-1cc8491ccd00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b47536e-a735-46a7-92e9-1cc8491ccd00', 'volume_size': 1} Sep 04 16:05:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:18 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2b710c18-260f-433a-80ca-cceede21980e" returned: 0 in 4.292s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d, size 1024.00 MB, duration 4.29 sec, destination /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2b710c18-260f-433a-80ca-cceede21980e {{(pid=87490) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 16:05:18 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Converted 1024.00 MB image at 238.53 MB/s Sep 04 16:05:18 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2b710c18-260f-433a-80ca-cceede21980e is being set with open permissions: ugo+rw Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2b710c18-260f-433a-80ca-cceede21980e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:18 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2b710c18-260f-433a-80ca-cceede21980e Sep 04 16:05:18 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:18 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2b710c18-260f-433a-80ca-cceede21980e" returned: 0 in 0.240s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Lock "cinder-quobyte-2b710c18-260f-433a-80ca-cceede21980e" released by "_copy_volume_from_snapshot" :: held 5.342s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Lock "cinder-quobyte-fa472c86-1b91-4f98-bad6-4f24e8d0c83a-2b710c18-260f-433a-80ca-cceede21980e" released by "_create_volume_from_snapshot" :: held 5.413s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.432s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.163s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-31573747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b47536e-a735-46a7-92e9-1cc8491ccd00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16a9d15f6ff44c0a90ab58b686c8bd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:17Z,use_quota=True,user_id='435d8808fadf46aea537a8d62eaa4aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Creating volume 7b47536e-a735-46a7-92e9-1cc8491ccd00 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:05:18 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7b47536e-a735-46a7-92e9-1cc8491ccd00 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:18 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7b47536e-a735-46a7-92e9-1cc8491ccd00 1073741824 Sep 04 16:05:18 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab57cfac-d2df-4190-9294-8564bb120b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b710c18-260f-433a-80ca-cceede21980e', 'volume_size': 1, 'snapshot_id': 'fa472c86-1b91-4f98-bad6-4f24e8d0c83a'}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2628c9-d6c7-4fb5-9af6-2f8d85650c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:18 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Volume volume-2b710c18-260f-433a-80ca-cceede21980e (2b710c18-260f-433a-80ca-cceede21980e): created successfully Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2628c9-d6c7-4fb5-9af6-2f8d85650c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Flow 'volume_create_manager' (efc0b3b6-745f-4e36-ae07-cb4610a1d299) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:18 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-e6d9d7f4-7184-4ce7-8533-3676a1057581 tempest-VolumeDependencyTests-452966670 None] Created volume successfully. Sep 04 16:05:18 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7b47536e-a735-46a7-92e9-1cc8491ccd00 1073741824" returned: 0 in 0.396s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7b47536e-a735-46a7-92e9-1cc8491ccd00 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:18 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7b47536e-a735-46a7-92e9-1cc8491ccd00 Sep 04 16:05:18 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:18 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7b47536e-a735-46a7-92e9-1cc8491ccd00" returned: 0 in 0.232s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c785a5-5893-4f17-bc9b-98c4bf2ae6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b47536e-a735-46a7-92e9-1cc8491ccd00', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17fc785e-219a-4426-91f1-e7b9fe839042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:19 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Volume volume-7b47536e-a735-46a7-92e9-1cc8491ccd00 (7b47536e-a735-46a7-92e9-1cc8491ccd00): created successfully Sep 04 16:05:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17fc785e-219a-4426-91f1-e7b9fe839042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Flow 'volume_create_manager' (8c3a0edc-6953-4e10-beea-fcc10c7b9576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:19 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-086fe30f-51de-4ad3-a24d-7e8127c6374f tempest-ProjectReaderTests-387081320 None] Created volume successfully. Sep 04 16:05:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-90dbfea2-11e9-4ab2-b713-d9a61f2d845b tempest-VolumeDependencyTests-452966670 None] Acquiring lock "cinder-fa472c86-1b91-4f98-bad6-4f24e8d0c83a-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-90dbfea2-11e9-4ab2-b713-d9a61f2d845b tempest-VolumeDependencyTests-452966670 None] Lock "cinder-fa472c86-1b91-4f98-bad6-4f24e8d0c83a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-90dbfea2-11e9-4ab2-b713-d9a61f2d845b tempest-VolumeDependencyTests-452966670 None] Acquiring lock "cinder-quobyte-15ae572e-0e1a-423b-8df5-5341be07ec6d" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-90dbfea2-11e9-4ab2-b713-d9a61f2d845b tempest-VolumeDependencyTests-452966670 None] Lock "cinder-quobyte-15ae572e-0e1a-423b-8df5-5341be07ec6d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-90dbfea2-11e9-4ab2-b713-d9a61f2d845b tempest-VolumeDependencyTests-452966670 None] Acquiring lock "cinder-quobyte-fa472c86-1b91-4f98-bad6-4f24e8d0c83a" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-90dbfea2-11e9-4ab2-b713-d9a61f2d845b tempest-VolumeDependencyTests-452966670 None] Lock "cinder-quobyte-fa472c86-1b91-4f98-bad6-4f24e8d0c83a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-90dbfea2-11e9-4ab2-b713-d9a61f2d845b tempest-VolumeDependencyTests-452966670 None] Deleting offline snapshot fa472c86-1b91-4f98-bad6-4f24e8d0c83a of volume 15ae572e-0e1a-423b-8df5-5341be07ec6d {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:05:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-90dbfea2-11e9-4ab2-b713-d9a61f2d845b tempest-VolumeDependencyTests-452966670 None] snapshot_file for this snap is: volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.fa472c86-1b91-4f98-bad6-4f24e8d0c83a {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:05:19 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[23573799-1ece-4b72-a26f-ad9929560f8b]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-90dbfea2-11e9-4ab2-b713-d9a61f2d845b tempest-VolumeDependencyTests-452966670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.fa472c86-1b91-4f98-bad6-4f24e8d0c83a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:19 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.fa472c86-1b91-4f98-bad6-4f24e8d0c83a Sep 04 16:05:19 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:19 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-90dbfea2-11e9-4ab2-b713-d9a61f2d845b tempest-VolumeDependencyTests-452966670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.fa472c86-1b91-4f98-bad6-4f24e8d0c83a" returned: 0 in 0.339s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-90dbfea2-11e9-4ab2-b713-d9a61f2d845b tempest-VolumeDependencyTests-452966670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15ae572e-0e1a-423b-8df5-5341be07ec6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:05:19 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd7588d-5e3f-4238-a60c-4cce54660b99]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-90dbfea2-11e9-4ab2-b713-d9a61f2d845b tempest-VolumeDependencyTests-452966670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:19 devstack sudo[104625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d Sep 04 16:05:19 devstack sudo[104625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:20 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-281d6a16-0c4f-4cd5-9914-b6ad211a8b40 tempest-ProjectReaderTests-387081320 None] Acquiring lock "cinder-7b47536e-a735-46a7-92e9-1cc8491ccd00-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:20 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-281d6a16-0c4f-4cd5-9914-b6ad211a8b40 tempest-ProjectReaderTests-387081320 None] Lock "cinder-7b47536e-a735-46a7-92e9-1cc8491ccd00-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:20 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-281d6a16-0c4f-4cd5-9914-b6ad211a8b40 tempest-ProjectReaderTests-387081320 None] Acquiring lock "cinder-quobyte-7b47536e-a735-46a7-92e9-1cc8491ccd00" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:20 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-281d6a16-0c4f-4cd5-9914-b6ad211a8b40 tempest-ProjectReaderTests-387081320 None] Lock "cinder-quobyte-7b47536e-a735-46a7-92e9-1cc8491ccd00" acquired by "delete_volume" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:20 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[132d2f17-400e-4b73-85ee-59fdcb659cce]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-281d6a16-0c4f-4cd5-9914-b6ad211a8b40 tempest-ProjectReaderTests-387081320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7b47536e-a735-46a7-92e9-1cc8491ccd00 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:20 devstack sudo[104625]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-90dbfea2-11e9-4ab2-b713-d9a61f2d845b tempest-VolumeDependencyTests-452966670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d" returned: 0 in 0.538s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-90dbfea2-11e9-4ab2-b713-d9a61f2d845b tempest-VolumeDependencyTests-452966670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.fa472c86-1b91-4f98-bad6-4f24e8d0c83a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:20 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.fa472c86-1b91-4f98-bad6-4f24e8d0c83a Sep 04 16:05:20 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:20 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7b47536e-a735-46a7-92e9-1cc8491ccd00 Sep 04 16:05:20 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:20 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-90dbfea2-11e9-4ab2-b713-d9a61f2d845b tempest-VolumeDependencyTests-452966670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.fa472c86-1b91-4f98-bad6-4f24e8d0c83a" returned: 0 in 0.324s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-90dbfea2-11e9-4ab2-b713-d9a61f2d845b tempest-VolumeDependencyTests-452966670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.fa472c86-1b91-4f98-bad6-4f24e8d0c83a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:20 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-281d6a16-0c4f-4cd5-9914-b6ad211a8b40 tempest-ProjectReaderTests-387081320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7b47536e-a735-46a7-92e9-1cc8491ccd00" returned: 0 in 0.362s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-281d6a16-0c4f-4cd5-9914-b6ad211a8b40 tempest-ProjectReaderTests-387081320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7b47536e-a735-46a7-92e9-1cc8491ccd00 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:20 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.fa472c86-1b91-4f98-bad6-4f24e8d0c83a Sep 04 16:05:20 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:20 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7b47536e-a735-46a7-92e9-1cc8491ccd00 Sep 04 16:05:20 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:20 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-90dbfea2-11e9-4ab2-b713-d9a61f2d845b tempest-VolumeDependencyTests-452966670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d.fa472c86-1b91-4f98-bad6-4f24e8d0c83a" returned: 0 in 0.254s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:20 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-281d6a16-0c4f-4cd5-9914-b6ad211a8b40 tempest-ProjectReaderTests-387081320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7b47536e-a735-46a7-92e9-1cc8491ccd00" returned: 0 in 0.252s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:20 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-90dbfea2-11e9-4ab2-b713-d9a61f2d845b tempest-VolumeDependencyTests-452966670 None] Lock "cinder-quobyte-fa472c86-1b91-4f98-bad6-4f24e8d0c83a" released by "_delete_snapshot" :: held 1.556s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:20 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-281d6a16-0c4f-4cd5-9914-b6ad211a8b40 tempest-ProjectReaderTests-387081320 None] Lock "cinder-quobyte-7b47536e-a735-46a7-92e9-1cc8491ccd00" released by "delete_volume" :: held 0.677s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:20 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-90dbfea2-11e9-4ab2-b713-d9a61f2d845b tempest-VolumeDependencyTests-452966670 None] Lock "cinder-quobyte-15ae572e-0e1a-423b-8df5-5341be07ec6d" released by "delete_snapshot" :: held 1.586s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:20 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-281d6a16-0c4f-4cd5-9914-b6ad211a8b40 tempest-ProjectReaderTests-387081320 None] Created reservations ['642a896e-64d8-4fcd-bad9-81547b56ec14', '9b388fc9-11e3-4932-b892-a8631723a28a', '4703d585-49d8-4789-a827-8c72c2edd86d', 'e5d60e9b-2d71-44e6-be10-b0a6ab2f516d'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:05:20 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-90dbfea2-11e9-4ab2-b713-d9a61f2d845b tempest-VolumeDependencyTests-452966670 None] Created reservations ['f41ff79f-ad5f-465d-aa9c-cafaee63a432', 'efe174ba-798b-4ca1-8766-fcb63f686a44', 'b136bd35-bead-43cd-9bed-bd212ce7ee92', 'b2799ffd-e6e3-4ea6-afa4-ba533a278ea0'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-281d6a16-0c4f-4cd5-9914-b6ad211a8b40 tempest-ProjectReaderTests-387081320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-281d6a16-0c4f-4cd5-9914-b6ad211a8b40 tempest-ProjectReaderTests-387081320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-281d6a16-0c4f-4cd5-9914-b6ad211a8b40 tempest-ProjectReaderTests-387081320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-281d6a16-0c4f-4cd5-9914-b6ad211a8b40 tempest-ProjectReaderTests-387081320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-281d6a16-0c4f-4cd5-9914-b6ad211a8b40 tempest-ProjectReaderTests-387081320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-281d6a16-0c4f-4cd5-9914-b6ad211a8b40 tempest-ProjectReaderTests-387081320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:21 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:05:21 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:21 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-90dbfea2-11e9-4ab2-b713-d9a61f2d845b tempest-VolumeDependencyTests-452966670 None] Delete snapshot completed successfully. Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-90dbfea2-11e9-4ab2-b713-d9a61f2d845b tempest-VolumeDependencyTests-452966670 None] Lock "cinder-fa472c86-1b91-4f98-bad6-4f24e8d0c83a-delete_snapshot" released by "delete_snapshot" :: held 1.806s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:21 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-281d6a16-0c4f-4cd5-9914-b6ad211a8b40 tempest-ProjectReaderTests-387081320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.263s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-281d6a16-0c4f-4cd5-9914-b6ad211a8b40 tempest-ProjectReaderTests-387081320 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:05:21 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-281d6a16-0c4f-4cd5-9914-b6ad211a8b40 tempest-ProjectReaderTests-387081320 None] Deleted volume successfully. Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-281d6a16-0c4f-4cd5-9914-b6ad211a8b40 tempest-ProjectReaderTests-387081320 None] Lock "cinder-7b47536e-a735-46a7-92e9-1cc8491ccd00-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6c20d410-bf34-4389-9428-793415b5f918 tempest-VolumeDependencyTests-452966670 None] Acquiring lock "cinder-15ae572e-0e1a-423b-8df5-5341be07ec6d-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6c20d410-bf34-4389-9428-793415b5f918 tempest-VolumeDependencyTests-452966670 None] Lock "cinder-15ae572e-0e1a-423b-8df5-5341be07ec6d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6c20d410-bf34-4389-9428-793415b5f918 tempest-VolumeDependencyTests-452966670 None] Acquiring lock "cinder-quobyte-15ae572e-0e1a-423b-8df5-5341be07ec6d" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6c20d410-bf34-4389-9428-793415b5f918 tempest-VolumeDependencyTests-452966670 None] Lock "cinder-quobyte-15ae572e-0e1a-423b-8df5-5341be07ec6d" acquired by "delete_volume" :: waited 0.016s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b774c7d-5837-43a0-8576-f4adee80db4e]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6c20d410-bf34-4389-9428-793415b5f918 tempest-VolumeDependencyTests-452966670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:21 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d Sep 04 16:05:21 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Flow 'volume_create_manager' (14cb61dc-7da2-458d-a1d3-acd717481a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d92743-e8a9-4aef-a98f-652538b8abe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6d92743-e8a9-4aef-a98f-652538b8abe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-315345282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f646bc5c-fd6d-4757-989b-b5bb13e466ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16a9d15f6ff44c0a90ab58b686c8bd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:22Z,use_quota=True,user_id='435d8808fadf46aea537a8d62eaa4aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9da37f-0938-4c3a-9184-9f0916765f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9da37f-0938-4c3a-9184-9f0916765f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9797926-2a29-4867-9708-3875c6208a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9797926-2a29-4867-9708-3875c6208a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f646bc5c-fd6d-4757-989b-b5bb13e466ce', 'volume_name': 'volume-f646bc5c-fd6d-4757-989b-b5bb13e466ce', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee66033-a3a3-4f2b-ac52-97edde956003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee66033-a3a3-4f2b-ac52-97edde956003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b225eab2-7cfe-45d9-ac62-c16810974f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:21 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Volume f646bc5c-fd6d-4757-989b-b5bb13e466ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f646bc5c-fd6d-4757-989b-b5bb13e466ce', 'volume_size': 1} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-315345282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f646bc5c-fd6d-4757-989b-b5bb13e466ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16a9d15f6ff44c0a90ab58b686c8bd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:22Z,use_quota=True,user_id='435d8808fadf46aea537a8d62eaa4aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Creating volume f646bc5c-fd6d-4757-989b-b5bb13e466ce {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:05:21 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f646bc5c-fd6d-4757-989b-b5bb13e466ce 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:21 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:21 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f646bc5c-fd6d-4757-989b-b5bb13e466ce 1073741824 Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6c20d410-bf34-4389-9428-793415b5f918 tempest-VolumeDependencyTests-452966670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d" returned: 0 in 0.380s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6c20d410-bf34-4389-9428-793415b5f918 tempest-VolumeDependencyTests-452966670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:21 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:21 devstack sudo[104658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d Sep 04 16:05:21 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:22 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6c20d410-bf34-4389-9428-793415b5f918 tempest-VolumeDependencyTests-452966670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-15ae572e-0e1a-423b-8df5-5341be07ec6d" returned: 0 in 0.238s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6c20d410-bf34-4389-9428-793415b5f918 tempest-VolumeDependencyTests-452966670 None] Lock "cinder-quobyte-15ae572e-0e1a-423b-8df5-5341be07ec6d" released by "delete_volume" :: held 0.680s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-6c20d410-bf34-4389-9428-793415b5f918 tempest-VolumeDependencyTests-452966670 None] Created reservations ['d841d50d-7a75-435b-b2f7-85471dfe70e0', 'a177d992-9d8b-4195-adec-9f7275179254', 'b13c31f6-e2e7-44e7-98ee-966ace4937d6', '441bfd3a-9a8b-4da6-8706-fe816d06f671'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6c20d410-bf34-4389-9428-793415b5f918 tempest-VolumeDependencyTests-452966670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6c20d410-bf34-4389-9428-793415b5f918 tempest-VolumeDependencyTests-452966670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-6c20d410-bf34-4389-9428-793415b5f918 tempest-VolumeDependencyTests-452966670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-6c20d410-bf34-4389-9428-793415b5f918 tempest-VolumeDependencyTests-452966670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:05:22 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6c20d410-bf34-4389-9428-793415b5f918 tempest-VolumeDependencyTests-452966670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6c20d410-bf34-4389-9428-793415b5f918 tempest-VolumeDependencyTests-452966670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f646bc5c-fd6d-4757-989b-b5bb13e466ce 1073741824" returned: 0 in 0.428s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:22 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:05:22 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f646bc5c-fd6d-4757-989b-b5bb13e466ce {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:22 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f646bc5c-fd6d-4757-989b-b5bb13e466ce Sep 04 16:05:22 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:22 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6c20d410-bf34-4389-9428-793415b5f918 tempest-VolumeDependencyTests-452966670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.264s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-6c20d410-bf34-4389-9428-793415b5f918 tempest-VolumeDependencyTests-452966670 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:05:22 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-6c20d410-bf34-4389-9428-793415b5f918 tempest-VolumeDependencyTests-452966670 None] Deleted volume successfully. Sep 04 16:05:22 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-48bf2783-8b6d-483c-8174-b56d65ef3abb tempest-VolumeDependencyTests-452966670 None] Acquiring lock "cinder-2b710c18-260f-433a-80ca-cceede21980e-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f646bc5c-fd6d-4757-989b-b5bb13e466ce" returned: 0 in 0.261s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-6c20d410-bf34-4389-9428-793415b5f918 tempest-VolumeDependencyTests-452966670 None] Lock "cinder-15ae572e-0e1a-423b-8df5-5341be07ec6d-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-48bf2783-8b6d-483c-8174-b56d65ef3abb tempest-VolumeDependencyTests-452966670 None] Lock "cinder-2b710c18-260f-433a-80ca-cceede21980e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b225eab2-7cfe-45d9-ac62-c16810974f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f646bc5c-fd6d-4757-989b-b5bb13e466ce', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (587cc072-181a-480a-b050-532eac917aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:22 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Volume volume-f646bc5c-fd6d-4757-989b-b5bb13e466ce (f646bc5c-fd6d-4757-989b-b5bb13e466ce): created successfully Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (587cc072-181a-480a-b050-532eac917aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Flow 'volume_create_manager' (14cb61dc-7da2-458d-a1d3-acd717481a37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-48bf2783-8b6d-483c-8174-b56d65ef3abb tempest-VolumeDependencyTests-452966670 None] Acquiring lock "cinder-quobyte-2b710c18-260f-433a-80ca-cceede21980e" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:22 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-8161a5f3-ef34-43ac-b94c-4423399f7b61 tempest-ProjectReaderTests-387081320 None] Created volume successfully. Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-48bf2783-8b6d-483c-8174-b56d65ef3abb tempest-VolumeDependencyTests-452966670 None] Lock "cinder-quobyte-2b710c18-260f-433a-80ca-cceede21980e" acquired by "delete_volume" :: waited 0.015s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[608add7a-925d-421b-99b8-8aabec00272c]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-48bf2783-8b6d-483c-8174-b56d65ef3abb tempest-VolumeDependencyTests-452966670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2b710c18-260f-433a-80ca-cceede21980e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-71aab32a-3388-408f-96d2-ebc9c8149fcb tempest-ProjectReaderTests-387081320 None] Acquiring lock "cinder-f646bc5c-fd6d-4757-989b-b5bb13e466ce-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:22 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2b710c18-260f-433a-80ca-cceede21980e Sep 04 16:05:22 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-71aab32a-3388-408f-96d2-ebc9c8149fcb tempest-ProjectReaderTests-387081320 None] Lock "cinder-f646bc5c-fd6d-4757-989b-b5bb13e466ce-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-71aab32a-3388-408f-96d2-ebc9c8149fcb tempest-ProjectReaderTests-387081320 None] Acquiring lock "cinder-quobyte-f646bc5c-fd6d-4757-989b-b5bb13e466ce" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-71aab32a-3388-408f-96d2-ebc9c8149fcb tempest-ProjectReaderTests-387081320 None] Lock "cinder-quobyte-f646bc5c-fd6d-4757-989b-b5bb13e466ce" acquired by "delete_volume" :: waited 0.014s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[0830039b-1174-4d83-8338-1476ceac4687]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-71aab32a-3388-408f-96d2-ebc9c8149fcb tempest-ProjectReaderTests-387081320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f646bc5c-fd6d-4757-989b-b5bb13e466ce {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:23 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f646bc5c-fd6d-4757-989b-b5bb13e466ce Sep 04 16:05:23 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:23 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-48bf2783-8b6d-483c-8174-b56d65ef3abb tempest-VolumeDependencyTests-452966670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2b710c18-260f-433a-80ca-cceede21980e" returned: 0 in 0.391s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-48bf2783-8b6d-483c-8174-b56d65ef3abb tempest-VolumeDependencyTests-452966670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2b710c18-260f-433a-80ca-cceede21980e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:23 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2b710c18-260f-433a-80ca-cceede21980e Sep 04 16:05:23 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:23 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-71aab32a-3388-408f-96d2-ebc9c8149fcb tempest-ProjectReaderTests-387081320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f646bc5c-fd6d-4757-989b-b5bb13e466ce" returned: 0 in 0.363s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-71aab32a-3388-408f-96d2-ebc9c8149fcb tempest-ProjectReaderTests-387081320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f646bc5c-fd6d-4757-989b-b5bb13e466ce {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:23 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f646bc5c-fd6d-4757-989b-b5bb13e466ce Sep 04 16:05:23 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:23 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-48bf2783-8b6d-483c-8174-b56d65ef3abb tempest-VolumeDependencyTests-452966670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2b710c18-260f-433a-80ca-cceede21980e" returned: 0 in 0.236s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-48bf2783-8b6d-483c-8174-b56d65ef3abb tempest-VolumeDependencyTests-452966670 None] Lock "cinder-quobyte-2b710c18-260f-433a-80ca-cceede21980e" released by "delete_volume" :: held 0.674s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:23 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-48bf2783-8b6d-483c-8174-b56d65ef3abb tempest-VolumeDependencyTests-452966670 None] Created reservations ['befaa64c-9175-456a-96f9-fca8e96e9962', 'a5b88282-181f-4ee8-8084-7d49686364db', '53f008ed-fc1d-44b8-a67f-b482ee618cb7', '29f67b4f-40dd-45a4-8d98-935bbb7142e9'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:05:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-48bf2783-8b6d-483c-8174-b56d65ef3abb tempest-VolumeDependencyTests-452966670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-48bf2783-8b6d-483c-8174-b56d65ef3abb tempest-VolumeDependencyTests-452966670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:23 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-48bf2783-8b6d-483c-8174-b56d65ef3abb tempest-VolumeDependencyTests-452966670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:05:23 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-48bf2783-8b6d-483c-8174-b56d65ef3abb tempest-VolumeDependencyTests-452966670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:05:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-48bf2783-8b6d-483c-8174-b56d65ef3abb tempest-VolumeDependencyTests-452966670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-48bf2783-8b6d-483c-8174-b56d65ef3abb tempest-VolumeDependencyTests-452966670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:23 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:05:23 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:23 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-71aab32a-3388-408f-96d2-ebc9c8149fcb tempest-ProjectReaderTests-387081320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f646bc5c-fd6d-4757-989b-b5bb13e466ce" returned: 0 in 0.268s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-71aab32a-3388-408f-96d2-ebc9c8149fcb tempest-ProjectReaderTests-387081320 None] Lock "cinder-quobyte-f646bc5c-fd6d-4757-989b-b5bb13e466ce" released by "delete_volume" :: held 0.668s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:23 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-71aab32a-3388-408f-96d2-ebc9c8149fcb tempest-ProjectReaderTests-387081320 None] Created reservations ['52ae2cd1-9702-4eab-9cd2-d115e36751c0', '9be0eb1d-98f8-4507-b84b-bd9bd468a5d7', '99c9915e-168d-4bea-ace9-b81c73bd2076', 'd03fbeff-7293-4989-8186-59635ef12ac0'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:05:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-71aab32a-3388-408f-96d2-ebc9c8149fcb tempest-ProjectReaderTests-387081320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-71aab32a-3388-408f-96d2-ebc9c8149fcb tempest-ProjectReaderTests-387081320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:23 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-71aab32a-3388-408f-96d2-ebc9c8149fcb tempest-ProjectReaderTests-387081320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:05:23 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-71aab32a-3388-408f-96d2-ebc9c8149fcb tempest-ProjectReaderTests-387081320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:05:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-71aab32a-3388-408f-96d2-ebc9c8149fcb tempest-ProjectReaderTests-387081320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-71aab32a-3388-408f-96d2-ebc9c8149fcb tempest-ProjectReaderTests-387081320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:23 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:05:23 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:23 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-48bf2783-8b6d-483c-8174-b56d65ef3abb tempest-VolumeDependencyTests-452966670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.301s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:23 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-48bf2783-8b6d-483c-8174-b56d65ef3abb tempest-VolumeDependencyTests-452966670 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:05:23 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-48bf2783-8b6d-483c-8174-b56d65ef3abb tempest-VolumeDependencyTests-452966670 None] Deleted volume successfully. Sep 04 16:05:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-48bf2783-8b6d-483c-8174-b56d65ef3abb tempest-VolumeDependencyTests-452966670 None] Lock "cinder-2b710c18-260f-433a-80ca-cceede21980e-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:24 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-71aab32a-3388-408f-96d2-ebc9c8149fcb tempest-ProjectReaderTests-387081320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.324s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:24 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-71aab32a-3388-408f-96d2-ebc9c8149fcb tempest-ProjectReaderTests-387081320 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:05:24 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-71aab32a-3388-408f-96d2-ebc9c8149fcb tempest-ProjectReaderTests-387081320 None] Deleted volume successfully. Sep 04 16:05:24 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-71aab32a-3388-408f-96d2-ebc9c8149fcb tempest-ProjectReaderTests-387081320 None] Lock "cinder-f646bc5c-fd6d-4757-989b-b5bb13e466ce-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:27 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:05:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Flow 'volume_create_manager' (608acf81-dcc0-441a-8ca3-759db2dc6189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36e46986-d4db-481b-bb73-9874c9450649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36e46986-d4db-481b-bb73-9874c9450649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca03c033-8685-4cad-a8ce-a444b31c867c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9851a5f31540d1b1ac6ce18003e85f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:27Z,use_quota=True,user_id='8c697493da254349ba38a4b88ea3d430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef42d9e-d9cc-4f49-885c-6880e2a36bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef42d9e-d9cc-4f49-885c-6880e2a36bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b73fa1-c029-46da-bc08-1793a8bf85aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b73fa1-c029-46da-bc08-1793a8bf85aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca03c033-8685-4cad-a8ce-a444b31c867c', 'volume_name': 'volume-ca03c033-8685-4cad-a8ce-a444b31c867c', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae8c851-dcf6-4c11-aba8-90af561d229b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae8c851-dcf6-4c11-aba8-90af561d229b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:27 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6f48f1-3544-4779-a151-a8d31cff14b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:27 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Volume ca03c033-8685-4cad-a8ce-a444b31c867c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca03c033-8685-4cad-a8ce-a444b31c867c', 'volume_size': 1} Sep 04 16:05:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:27 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca03c033-8685-4cad-a8ce-a444b31c867c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9851a5f31540d1b1ac6ce18003e85f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:27Z,use_quota=True,user_id='8c697493da254349ba38a4b88ea3d430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:05:27 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Creating volume ca03c033-8685-4cad-a8ce-a444b31c867c {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:05:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:27 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:05:27 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:05:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:27 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:05:27 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:05:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ca03c033-8685-4cad-a8ce-a444b31c867c 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:27 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ca03c033-8685-4cad-a8ce-a444b31c867c 1073741824 Sep 04 16:05:27 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:27 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ca03c033-8685-4cad-a8ce-a444b31c867c 1073741824" returned: 0 in 0.437s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ca03c033-8685-4cad-a8ce-a444b31c867c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:27 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ca03c033-8685-4cad-a8ce-a444b31c867c Sep 04 16:05:27 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:28 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ca03c033-8685-4cad-a8ce-a444b31c867c" returned: 0 in 0.267s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:28 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:05:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:28 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6f48f1-3544-4779-a151-a8d31cff14b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca03c033-8685-4cad-a8ce-a444b31c867c', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:28 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a9b329-e77c-4ae2-a004-96fa6b0ab0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:28 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Volume volume-ca03c033-8685-4cad-a8ce-a444b31c867c (ca03c033-8685-4cad-a8ce-a444b31c867c): created successfully Sep 04 16:05:28 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a9b329-e77c-4ae2-a004-96fa6b0ab0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:28 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Flow 'volume_create_manager' (608acf81-dcc0-441a-8ca3-759db2dc6189) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:28 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-307e2cb6-fbff-4d9d-9960-54b85ee71b34 tempest-CinderUnicodeTest-1881559315 None] Created volume successfully. Sep 04 16:05:29 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:05:29 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Flow 'volume_create_manager' (c5518831-9e1a-4336-b9c8-71a95daa7cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:29 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84f52dd-46ff-49d1-b19a-7bf888c7d60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:29 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84f52dd-46ff-49d1-b19a-7bf888c7d60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-658979009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1408df5-b167-42ae-bed4-d8efaea172db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9851a5f31540d1b1ac6ce18003e85f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:30Z,use_quota=True,user_id='8c697493da254349ba38a4b88ea3d430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:29 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa0ceb47-5f1b-4e29-a9d6-99cdb7dce892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:29 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa0ceb47-5f1b-4e29-a9d6-99cdb7dce892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:29 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eacec43-75be-4d97-880a-c738afce152d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:29 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eacec43-75be-4d97-880a-c738afce152d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1408df5-b167-42ae-bed4-d8efaea172db', 'volume_name': 'volume-c1408df5-b167-42ae-bed4-d8efaea172db', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:29 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1baa4b4-f314-4a76-b789-edef832c3991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:29 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1baa4b4-f314-4a76-b789-edef832c3991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:30 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b595e89b-af60-4d2a-9440-413c6e850abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:30 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Volume c1408df5-b167-42ae-bed4-d8efaea172db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1408df5-b167-42ae-bed4-d8efaea172db', 'volume_size': 1} Sep 04 16:05:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:30 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-658979009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1408df5-b167-42ae-bed4-d8efaea172db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c9851a5f31540d1b1ac6ce18003e85f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:30Z,use_quota=True,user_id='8c697493da254349ba38a4b88ea3d430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:05:30 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Creating volume c1408df5-b167-42ae-bed4-d8efaea172db {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:05:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:30 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:05:30 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:05:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:30 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:05:30 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:05:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:30 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db 1073741824 Sep 04 16:05:30 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:30 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db 1073741824" returned: 0 in 0.605s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:30 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db Sep 04 16:05:30 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:31 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db" returned: 0 in 0.344s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:31 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:05:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b595e89b-af60-4d2a-9440-413c6e850abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1408df5-b167-42ae-bed4-d8efaea172db', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f5458e-2fbd-4273-863d-06c05f9e5aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:31 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Volume volume-c1408df5-b167-42ae-bed4-d8efaea172db (c1408df5-b167-42ae-bed4-d8efaea172db): created successfully Sep 04 16:05:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f5458e-2fbd-4273-863d-06c05f9e5aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Flow 'volume_create_manager' (c5518831-9e1a-4336-b9c8-71a95daa7cc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:31 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-9f125e04-32be-4d86-b790-883eb70c244b tempest-CinderUnicodeTest-1881559315 None] Created volume successfully. Sep 04 16:05:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f79f6e8a-9f83-4b9f-81a1-0652b7a9e87a tempest-CinderUnicodeTest-1881559315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f79f6e8a-9f83-4b9f-81a1-0652b7a9e87a tempest-CinderUnicodeTest-1881559315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-f79f6e8a-9f83-4b9f-81a1-0652b7a9e87a tempest-CinderUnicodeTest-1881559315 None] Creating offline snapshot 656005bd-aa3a-4926-b899-600c3eb47c4d of volume c1408df5-b167-42ae-bed4-d8efaea172db {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:05:32 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0a70fe-a484-4f37-b7c0-a69ac7e6df8a]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f79f6e8a-9f83-4b9f-81a1-0652b7a9e87a tempest-CinderUnicodeTest-1881559315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:32 devstack sudo[104750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db Sep 04 16:05:32 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:32 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f79f6e8a-9f83-4b9f-81a1-0652b7a9e87a tempest-CinderUnicodeTest-1881559315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db" returned: 0 in 0.398s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f79f6e8a-9f83-4b9f-81a1-0652b7a9e87a tempest-CinderUnicodeTest-1881559315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db.656005bd-aa3a-4926-b899-600c3eb47c4d 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:32 devstack sudo[104755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db.656005bd-aa3a-4926-b899-600c3eb47c4d 1G Sep 04 16:05:32 devstack sudo[104755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:33 devstack sudo[104755]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f79f6e8a-9f83-4b9f-81a1-0652b7a9e87a tempest-CinderUnicodeTest-1881559315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db.656005bd-aa3a-4926-b899-600c3eb47c4d 1G" returned: 0 in 0.451s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f79f6e8a-9f83-4b9f-81a1-0652b7a9e87a tempest-CinderUnicodeTest-1881559315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1408df5-b167-42ae-bed4-d8efaea172db -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db.656005bd-aa3a-4926-b899-600c3eb47c4d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:33 devstack sudo[104761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1408df5-b167-42ae-bed4-d8efaea172db -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db.656005bd-aa3a-4926-b899-600c3eb47c4d Sep 04 16:05:33 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:33 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f79f6e8a-9f83-4b9f-81a1-0652b7a9e87a tempest-CinderUnicodeTest-1881559315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1408df5-b167-42ae-bed4-d8efaea172db -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db.656005bd-aa3a-4926-b899-600c3eb47c4d" returned: 0 in 0.333s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:33 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-f79f6e8a-9f83-4b9f-81a1-0652b7a9e87a tempest-CinderUnicodeTest-1881559315 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db.656005bd-aa3a-4926-b899-600c3eb47c4d is being set with open permissions: ugo+rw Sep 04 16:05:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f79f6e8a-9f83-4b9f-81a1-0652b7a9e87a tempest-CinderUnicodeTest-1881559315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db.656005bd-aa3a-4926-b899-600c3eb47c4d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:33 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db.656005bd-aa3a-4926-b899-600c3eb47c4d Sep 04 16:05:33 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:33 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f79f6e8a-9f83-4b9f-81a1-0652b7a9e87a tempest-CinderUnicodeTest-1881559315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db.656005bd-aa3a-4926-b899-600c3eb47c4d" returned: 0 in 0.249s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f79f6e8a-9f83-4b9f-81a1-0652b7a9e87a tempest-CinderUnicodeTest-1881559315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:33 devstack sudo[104769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db.info Sep 04 16:05:33 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:34 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f79f6e8a-9f83-4b9f-81a1-0652b7a9e87a tempest-CinderUnicodeTest-1881559315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db.info" returned: 0 in 0.252s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:34 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-f79f6e8a-9f83-4b9f-81a1-0652b7a9e87a tempest-CinderUnicodeTest-1881559315 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db.info is being set with open permissions: ugo+rw Sep 04 16:05:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f79f6e8a-9f83-4b9f-81a1-0652b7a9e87a tempest-CinderUnicodeTest-1881559315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:34 devstack sudo[104772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db.info Sep 04 16:05:34 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:34 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f79f6e8a-9f83-4b9f-81a1-0652b7a9e87a tempest-CinderUnicodeTest-1881559315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db.info" returned: 0 in 0.259s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f79f6e8a-9f83-4b9f-81a1-0652b7a9e87a tempest-CinderUnicodeTest-1881559315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.041s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:34 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-f79f6e8a-9f83-4b9f-81a1-0652b7a9e87a tempest-CinderUnicodeTest-1881559315 None] Create snapshot completed successfully Sep 04 16:05:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1faa95af-c86c-4b02-9975-41be9d939b2d tempest-CinderUnicodeTest-1881559315 None] Acquiring lock "cinder-656005bd-aa3a-4926-b899-600c3eb47c4d-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1faa95af-c86c-4b02-9975-41be9d939b2d tempest-CinderUnicodeTest-1881559315 None] Lock "cinder-656005bd-aa3a-4926-b899-600c3eb47c4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1faa95af-c86c-4b02-9975-41be9d939b2d tempest-CinderUnicodeTest-1881559315 None] Acquiring lock "cinder-quobyte-c1408df5-b167-42ae-bed4-d8efaea172db" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1faa95af-c86c-4b02-9975-41be9d939b2d tempest-CinderUnicodeTest-1881559315 None] Lock "cinder-quobyte-c1408df5-b167-42ae-bed4-d8efaea172db" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1faa95af-c86c-4b02-9975-41be9d939b2d tempest-CinderUnicodeTest-1881559315 None] Acquiring lock "cinder-quobyte-656005bd-aa3a-4926-b899-600c3eb47c4d" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1faa95af-c86c-4b02-9975-41be9d939b2d tempest-CinderUnicodeTest-1881559315 None] Lock "cinder-quobyte-656005bd-aa3a-4926-b899-600c3eb47c4d" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-1faa95af-c86c-4b02-9975-41be9d939b2d tempest-CinderUnicodeTest-1881559315 None] Deleting offline snapshot 656005bd-aa3a-4926-b899-600c3eb47c4d of volume c1408df5-b167-42ae-bed4-d8efaea172db {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:05:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-1faa95af-c86c-4b02-9975-41be9d939b2d tempest-CinderUnicodeTest-1881559315 None] snapshot_file for this snap is: volume-c1408df5-b167-42ae-bed4-d8efaea172db.656005bd-aa3a-4926-b899-600c3eb47c4d {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:05:35 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12bb2e3-6984-43e2-9596-7d339d93c7bf]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1faa95af-c86c-4b02-9975-41be9d939b2d tempest-CinderUnicodeTest-1881559315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db.656005bd-aa3a-4926-b899-600c3eb47c4d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:35 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db.656005bd-aa3a-4926-b899-600c3eb47c4d Sep 04 16:05:35 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:35 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1faa95af-c86c-4b02-9975-41be9d939b2d tempest-CinderUnicodeTest-1881559315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db.656005bd-aa3a-4926-b899-600c3eb47c4d" returned: 0 in 0.379s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-1faa95af-c86c-4b02-9975-41be9d939b2d tempest-CinderUnicodeTest-1881559315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1408df5-b167-42ae-bed4-d8efaea172db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:05:36 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1905853-d073-4c5f-9230-6374448f5bec]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1faa95af-c86c-4b02-9975-41be9d939b2d tempest-CinderUnicodeTest-1881559315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:36 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db Sep 04 16:05:36 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:36 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1faa95af-c86c-4b02-9975-41be9d939b2d tempest-CinderUnicodeTest-1881559315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db" returned: 0 in 0.370s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1faa95af-c86c-4b02-9975-41be9d939b2d tempest-CinderUnicodeTest-1881559315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db.656005bd-aa3a-4926-b899-600c3eb47c4d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:36 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db.656005bd-aa3a-4926-b899-600c3eb47c4d Sep 04 16:05:36 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:36 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1faa95af-c86c-4b02-9975-41be9d939b2d tempest-CinderUnicodeTest-1881559315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db.656005bd-aa3a-4926-b899-600c3eb47c4d" returned: 0 in 0.336s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1faa95af-c86c-4b02-9975-41be9d939b2d tempest-CinderUnicodeTest-1881559315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db.656005bd-aa3a-4926-b899-600c3eb47c4d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:36 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db.656005bd-aa3a-4926-b899-600c3eb47c4d Sep 04 16:05:36 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:37 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1faa95af-c86c-4b02-9975-41be9d939b2d tempest-CinderUnicodeTest-1881559315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db.656005bd-aa3a-4926-b899-600c3eb47c4d" returned: 0 in 0.329s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:37 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1faa95af-c86c-4b02-9975-41be9d939b2d tempest-CinderUnicodeTest-1881559315 None] Lock "cinder-quobyte-656005bd-aa3a-4926-b899-600c3eb47c4d" released by "_delete_snapshot" :: held 1.542s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:37 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1faa95af-c86c-4b02-9975-41be9d939b2d tempest-CinderUnicodeTest-1881559315 None] Lock "cinder-quobyte-c1408df5-b167-42ae-bed4-d8efaea172db" released by "delete_snapshot" :: held 1.589s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:37 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-1faa95af-c86c-4b02-9975-41be9d939b2d tempest-CinderUnicodeTest-1881559315 None] Created reservations ['ab4cd656-5595-4eda-bce6-17e45cafc713', '7d519d97-8afa-4ef8-9055-9757a1b7bd33', 'f86a8796-031b-4a94-914f-e98b6f9fac4d', '81ca6679-8d49-492d-adc9-fdf91e4b6015'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:05:37 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-1faa95af-c86c-4b02-9975-41be9d939b2d tempest-CinderUnicodeTest-1881559315 None] Delete snapshot completed successfully. Sep 04 16:05:37 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1faa95af-c86c-4b02-9975-41be9d939b2d tempest-CinderUnicodeTest-1881559315 None] Lock "cinder-656005bd-aa3a-4926-b899-600c3eb47c4d-delete_snapshot" released by "delete_snapshot" :: held 1.747s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:37 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0370fdde-d7a3-43f7-a375-b3f8d02e2fc1 tempest-CinderUnicodeTest-1881559315 None] Acquiring lock "cinder-c1408df5-b167-42ae-bed4-d8efaea172db-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:37 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0370fdde-d7a3-43f7-a375-b3f8d02e2fc1 tempest-CinderUnicodeTest-1881559315 None] Lock "cinder-c1408df5-b167-42ae-bed4-d8efaea172db-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:37 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0370fdde-d7a3-43f7-a375-b3f8d02e2fc1 tempest-CinderUnicodeTest-1881559315 None] Acquiring lock "cinder-quobyte-c1408df5-b167-42ae-bed4-d8efaea172db" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:37 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0370fdde-d7a3-43f7-a375-b3f8d02e2fc1 tempest-CinderUnicodeTest-1881559315 None] Lock "cinder-quobyte-c1408df5-b167-42ae-bed4-d8efaea172db" acquired by "delete_volume" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:37 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[1589d813-8f2a-4a62-98dd-22ca6e414fee]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0370fdde-d7a3-43f7-a375-b3f8d02e2fc1 tempest-CinderUnicodeTest-1881559315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:37 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db Sep 04 16:05:37 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:38 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0370fdde-d7a3-43f7-a375-b3f8d02e2fc1 tempest-CinderUnicodeTest-1881559315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db" returned: 0 in 0.386s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0370fdde-d7a3-43f7-a375-b3f8d02e2fc1 tempest-CinderUnicodeTest-1881559315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:38 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db Sep 04 16:05:38 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:38 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:05:38 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:38 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0370fdde-d7a3-43f7-a375-b3f8d02e2fc1 tempest-CinderUnicodeTest-1881559315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-c1408df5-b167-42ae-bed4-d8efaea172db" returned: 0 in 0.283s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0370fdde-d7a3-43f7-a375-b3f8d02e2fc1 tempest-CinderUnicodeTest-1881559315 None] Lock "cinder-quobyte-c1408df5-b167-42ae-bed4-d8efaea172db" released by "delete_volume" :: held 0.740s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:38 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.275s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager._thread_info {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread count: 28 {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread info: [<_MainThread(MainThread, started 138899118923904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-0370fdde-d7a3-43f7-a375-b3f8d02e2fc1 tempest-CinderUnicodeTest-1881559315 None] Created reservations ['d2437723-968f-415c-9108-24abef068389', 'f75b921e-3ffa-40c4-9a11-d055bfbbea35', 'e83903f4-bf0d-4a6c-bdd4-3069638cf048', '93e74e3c-8872-4001-bf91-a765e7b08161'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0370fdde-d7a3-43f7-a375-b3f8d02e2fc1 tempest-CinderUnicodeTest-1881559315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0370fdde-d7a3-43f7-a375-b3f8d02e2fc1 tempest-CinderUnicodeTest-1881559315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-0370fdde-d7a3-43f7-a375-b3f8d02e2fc1 tempest-CinderUnicodeTest-1881559315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-0370fdde-d7a3-43f7-a375-b3f8d02e2fc1 tempest-CinderUnicodeTest-1881559315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0370fdde-d7a3-43f7-a375-b3f8d02e2fc1 tempest-CinderUnicodeTest-1881559315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0370fdde-d7a3-43f7-a375-b3f8d02e2fc1 tempest-CinderUnicodeTest-1881559315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:38 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:05:38 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:38 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b59ba274-6f9c-482c-a7ea-4539b5e3515d tempest-CinderUnicodeTest-1881559315 None] Acquiring lock "cinder-ca03c033-8685-4cad-a8ce-a444b31c867c-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0370fdde-d7a3-43f7-a375-b3f8d02e2fc1 tempest-CinderUnicodeTest-1881559315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.246s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-0370fdde-d7a3-43f7-a375-b3f8d02e2fc1 tempest-CinderUnicodeTest-1881559315 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:05:38 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-0370fdde-d7a3-43f7-a375-b3f8d02e2fc1 tempest-CinderUnicodeTest-1881559315 None] Deleted volume successfully. Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b59ba274-6f9c-482c-a7ea-4539b5e3515d tempest-CinderUnicodeTest-1881559315 None] Lock "cinder-ca03c033-8685-4cad-a8ce-a444b31c867c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0370fdde-d7a3-43f7-a375-b3f8d02e2fc1 tempest-CinderUnicodeTest-1881559315 None] Lock "cinder-c1408df5-b167-42ae-bed4-d8efaea172db-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b59ba274-6f9c-482c-a7ea-4539b5e3515d tempest-CinderUnicodeTest-1881559315 None] Acquiring lock "cinder-quobyte-ca03c033-8685-4cad-a8ce-a444b31c867c" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b59ba274-6f9c-482c-a7ea-4539b5e3515d tempest-CinderUnicodeTest-1881559315 None] Lock "cinder-quobyte-ca03c033-8685-4cad-a8ce-a444b31c867c" acquired by "delete_volume" :: waited 0.014s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce805ef-8616-4037-8a25-15281bf0d817]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b59ba274-6f9c-482c-a7ea-4539b5e3515d tempest-CinderUnicodeTest-1881559315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ca03c033-8685-4cad-a8ce-a444b31c867c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:39 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ca03c033-8685-4cad-a8ce-a444b31c867c Sep 04 16:05:39 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:39 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b59ba274-6f9c-482c-a7ea-4539b5e3515d tempest-CinderUnicodeTest-1881559315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ca03c033-8685-4cad-a8ce-a444b31c867c" returned: 0 in 0.433s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b59ba274-6f9c-482c-a7ea-4539b5e3515d tempest-CinderUnicodeTest-1881559315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ca03c033-8685-4cad-a8ce-a444b31c867c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:39 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ca03c033-8685-4cad-a8ce-a444b31c867c Sep 04 16:05:39 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:39 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b59ba274-6f9c-482c-a7ea-4539b5e3515d tempest-CinderUnicodeTest-1881559315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ca03c033-8685-4cad-a8ce-a444b31c867c" returned: 0 in 0.258s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:39 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b59ba274-6f9c-482c-a7ea-4539b5e3515d tempest-CinderUnicodeTest-1881559315 None] Lock "cinder-quobyte-ca03c033-8685-4cad-a8ce-a444b31c867c" released by "delete_volume" :: held 0.730s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:39 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-b59ba274-6f9c-482c-a7ea-4539b5e3515d tempest-CinderUnicodeTest-1881559315 None] Created reservations ['32fd3583-cf76-4bd8-b6e8-4555709abccb', 'f6b190f0-3023-40d6-831e-8cef73f4fb82', '1d2a34fa-ae1f-4754-afdf-3ee5da2f8f86', '43661858-d9c6-481e-a42a-d4a9248be91f'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:05:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b59ba274-6f9c-482c-a7ea-4539b5e3515d tempest-CinderUnicodeTest-1881559315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b59ba274-6f9c-482c-a7ea-4539b5e3515d tempest-CinderUnicodeTest-1881559315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b59ba274-6f9c-482c-a7ea-4539b5e3515d tempest-CinderUnicodeTest-1881559315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:05:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b59ba274-6f9c-482c-a7ea-4539b5e3515d tempest-CinderUnicodeTest-1881559315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:05:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b59ba274-6f9c-482c-a7ea-4539b5e3515d tempest-CinderUnicodeTest-1881559315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b59ba274-6f9c-482c-a7ea-4539b5e3515d tempest-CinderUnicodeTest-1881559315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:39 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:05:39 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:40 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b59ba274-6f9c-482c-a7ea-4539b5e3515d tempest-CinderUnicodeTest-1881559315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.273s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:40 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-b59ba274-6f9c-482c-a7ea-4539b5e3515d tempest-CinderUnicodeTest-1881559315 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:05:40 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-b59ba274-6f9c-482c-a7ea-4539b5e3515d tempest-CinderUnicodeTest-1881559315 None] Deleted volume successfully. Sep 04 16:05:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b59ba274-6f9c-482c-a7ea-4539b5e3515d tempest-CinderUnicodeTest-1881559315 None] Lock "cinder-ca03c033-8685-4cad-a8ce-a444b31c867c-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:49 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:05:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Flow 'volume_create_manager' (569bb5aa-40d7-4844-ab7d-234fc0ee579d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed35b6b-9e9d-42d8-a0ca-be71a9b28854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed35b6b-9e9d-42d8-a0ca-be71a9b28854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2085412979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68b8e357-b906-446a-9c13-d43277bce8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='523c6c4d0f2b4807a248e68e7a12d573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:49Z,use_quota=True,user_id='81a23e24815640848cc0a65783fd32a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00360ca2-9140-418c-8420-f9de06f2738b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00360ca2-9140-418c-8420-f9de06f2738b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3643c4bd-bed7-48c9-9263-45d5fa47ddca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3643c4bd-bed7-48c9-9263-45d5fa47ddca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68b8e357-b906-446a-9c13-d43277bce8f1', 'volume_name': 'volume-68b8e357-b906-446a-9c13-d43277bce8f1', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dcd35c5-5602-49a3-a0a1-482a3d0b811a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dcd35c5-5602-49a3-a0a1-482a3d0b811a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c57ea54b-674d-4b3c-bf35-21a60e9fa767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:49 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Volume 68b8e357-b906-446a-9c13-d43277bce8f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68b8e357-b906-446a-9c13-d43277bce8f1', 'volume_size': 1} Sep 04 16:05:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2085412979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68b8e357-b906-446a-9c13-d43277bce8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='523c6c4d0f2b4807a248e68e7a12d573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:49Z,use_quota=True,user_id='81a23e24815640848cc0a65783fd32a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:05:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Creating volume 68b8e357-b906-446a-9c13-d43277bce8f1 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:05:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:05:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:05:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:05:49 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:05:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-68b8e357-b906-446a-9c13-d43277bce8f1 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:49 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-68b8e357-b906-446a-9c13-d43277bce8f1 1073741824 Sep 04 16:05:49 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:49 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-68b8e357-b906-446a-9c13-d43277bce8f1 1073741824" returned: 0 in 0.509s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-68b8e357-b906-446a-9c13-d43277bce8f1 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:50 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-68b8e357-b906-446a-9c13-d43277bce8f1 Sep 04 16:05:50 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:50 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-68b8e357-b906-446a-9c13-d43277bce8f1" returned: 0 in 0.277s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:05:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c57ea54b-674d-4b3c-bf35-21a60e9fa767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68b8e357-b906-446a-9c13-d43277bce8f1', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28ab795-6486-4495-b205-b99175227860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:50 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Volume volume-68b8e357-b906-446a-9c13-d43277bce8f1 (68b8e357-b906-446a-9c13-d43277bce8f1): created successfully Sep 04 16:05:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28ab795-6486-4495-b205-b99175227860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Flow 'volume_create_manager' (569bb5aa-40d7-4844-ab7d-234fc0ee579d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:50 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-aecbde21-1474-4725-8bee-d29096f5a05b tempest-ProjectReaderTests-283568500 None] Created volume successfully. Sep 04 16:05:51 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-244f1d8b-bcaf-46df-8745-a77c3238c6dd tempest-ProjectReaderTests-283568500 None] Acquiring lock "cinder-68b8e357-b906-446a-9c13-d43277bce8f1-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:51 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-244f1d8b-bcaf-46df-8745-a77c3238c6dd tempest-ProjectReaderTests-283568500 None] Lock "cinder-68b8e357-b906-446a-9c13-d43277bce8f1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:51 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-244f1d8b-bcaf-46df-8745-a77c3238c6dd tempest-ProjectReaderTests-283568500 None] Acquiring lock "cinder-quobyte-68b8e357-b906-446a-9c13-d43277bce8f1" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:51 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-244f1d8b-bcaf-46df-8745-a77c3238c6dd tempest-ProjectReaderTests-283568500 None] Lock "cinder-quobyte-68b8e357-b906-446a-9c13-d43277bce8f1" acquired by "delete_volume" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:51 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[151874ee-6e8b-413b-8665-08266ac43d06]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-244f1d8b-bcaf-46df-8745-a77c3238c6dd tempest-ProjectReaderTests-283568500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-68b8e357-b906-446a-9c13-d43277bce8f1 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:51 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-68b8e357-b906-446a-9c13-d43277bce8f1 Sep 04 16:05:51 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:52 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-244f1d8b-bcaf-46df-8745-a77c3238c6dd tempest-ProjectReaderTests-283568500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-68b8e357-b906-446a-9c13-d43277bce8f1" returned: 0 in 0.384s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-244f1d8b-bcaf-46df-8745-a77c3238c6dd tempest-ProjectReaderTests-283568500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-68b8e357-b906-446a-9c13-d43277bce8f1 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:52 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-68b8e357-b906-446a-9c13-d43277bce8f1 Sep 04 16:05:52 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:52 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-244f1d8b-bcaf-46df-8745-a77c3238c6dd tempest-ProjectReaderTests-283568500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-68b8e357-b906-446a-9c13-d43277bce8f1" returned: 0 in 0.338s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-244f1d8b-bcaf-46df-8745-a77c3238c6dd tempest-ProjectReaderTests-283568500 None] Lock "cinder-quobyte-68b8e357-b906-446a-9c13-d43277bce8f1" released by "delete_volume" :: held 0.780s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:52 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-244f1d8b-bcaf-46df-8745-a77c3238c6dd tempest-ProjectReaderTests-283568500 None] Created reservations ['b2c92a85-2fac-4105-81b8-e5f1a00c0ee7', '894413f9-3cf6-4576-9ce6-eab4a592a9fd', 'a6f29c2b-3c99-4b9c-aaac-6b0e494af8f3', '4ef45394-df89-4643-8be4-67fc48268e94'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:05:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-244f1d8b-bcaf-46df-8745-a77c3238c6dd tempest-ProjectReaderTests-283568500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-244f1d8b-bcaf-46df-8745-a77c3238c6dd tempest-ProjectReaderTests-283568500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:52 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-244f1d8b-bcaf-46df-8745-a77c3238c6dd tempest-ProjectReaderTests-283568500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:05:52 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-244f1d8b-bcaf-46df-8745-a77c3238c6dd tempest-ProjectReaderTests-283568500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:05:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-244f1d8b-bcaf-46df-8745-a77c3238c6dd tempest-ProjectReaderTests-283568500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-244f1d8b-bcaf-46df-8745-a77c3238c6dd tempest-ProjectReaderTests-283568500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:52 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:05:52 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:53 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-244f1d8b-bcaf-46df-8745-a77c3238c6dd tempest-ProjectReaderTests-283568500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.394s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:53 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-244f1d8b-bcaf-46df-8745-a77c3238c6dd tempest-ProjectReaderTests-283568500 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:05:53 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-244f1d8b-bcaf-46df-8745-a77c3238c6dd tempest-ProjectReaderTests-283568500 None] Deleted volume successfully. Sep 04 16:05:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-244f1d8b-bcaf-46df-8745-a77c3238c6dd tempest-ProjectReaderTests-283568500 None] Lock "cinder-68b8e357-b906-446a-9c13-d43277bce8f1-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:53 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:05:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Flow 'volume_create_manager' (93139954-4faf-40c6-956b-b3da0eacd0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dabaace9-de6b-4827-8c10-43889d9988dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dabaace9-de6b-4827-8c10-43889d9988dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-276350275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=067395e6-122d-4583-88fd-62732422919d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='523c6c4d0f2b4807a248e68e7a12d573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:53Z,use_quota=True,user_id='81a23e24815640848cc0a65783fd32a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ffb587-2798-4e2e-b278-f4b78a19ff9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ffb587-2798-4e2e-b278-f4b78a19ff9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad0a8bb-652f-4e13-892d-788d5d400291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad0a8bb-652f-4e13-892d-788d5d400291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '067395e6-122d-4583-88fd-62732422919d', 'volume_name': 'volume-067395e6-122d-4583-88fd-62732422919d', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1739d7fe-b685-4ada-bf0b-25e75b4e5a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1739d7fe-b685-4ada-bf0b-25e75b4e5a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72e99267-ad2b-409f-bfbb-fca5ce999c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:53 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Volume 067395e6-122d-4583-88fd-62732422919d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-067395e6-122d-4583-88fd-62732422919d', 'volume_size': 1} Sep 04 16:05:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-276350275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=067395e6-122d-4583-88fd-62732422919d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='523c6c4d0f2b4807a248e68e7a12d573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:53Z,use_quota=True,user_id='81a23e24815640848cc0a65783fd32a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:05:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Creating volume 067395e6-122d-4583-88fd-62732422919d {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:05:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:05:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:05:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:05:53 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:05:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-067395e6-122d-4583-88fd-62732422919d 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:53 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-067395e6-122d-4583-88fd-62732422919d 1073741824 Sep 04 16:05:53 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Flow 'volume_create_manager' (28e5c487-229a-4bb7-abde-14283dd13566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97906664-cb9f-45f1-886a-07d761ffa568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97906664-cb9f-45f1-886a-07d761ffa568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-938808819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81eae593-d733-47c3-b04a-285d2d138cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f14e40f352e4b5dacea1c9d0f950e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:54Z,use_quota=True,user_id='db47506a13ac4f91b3f7bce6570b5f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0913cff-d7a4-40e8-9866-da664980b0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0913cff-d7a4-40e8-9866-da664980b0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeaa4b23-1324-4f60-a58e-4f435f2c261e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:54 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeaa4b23-1324-4f60-a58e-4f435f2c261e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81eae593-d733-47c3-b04a-285d2d138cca', 'volume_name': 'volume-81eae593-d733-47c3-b04a-285d2d138cca', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1772c83-7da0-430c-befa-5d8335ee8fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1772c83-7da0-430c-befa-5d8335ee8fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bdda0d6-310f-420e-a4b2-048e43f2d331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:54 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Volume 81eae593-d733-47c3-b04a-285d2d138cca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81eae593-d733-47c3-b04a-285d2d138cca', 'volume_size': 1} Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-067395e6-122d-4583-88fd-62732422919d 1073741824" returned: 0 in 0.567s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-067395e6-122d-4583-88fd-62732422919d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:54 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-067395e6-122d-4583-88fd-62732422919d Sep 04 16:05:54 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:54 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-067395e6-122d-4583-88fd-62732422919d" returned: 0 in 0.251s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.292s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-938808819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81eae593-d733-47c3-b04a-285d2d138cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f14e40f352e4b5dacea1c9d0f950e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:54Z,use_quota=True,user_id='db47506a13ac4f91b3f7bce6570b5f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Creating volume 81eae593-d733-47c3-b04a-285d2d138cca {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:05:54 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72e99267-ad2b-409f-bfbb-fca5ce999c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-067395e6-122d-4583-88fd-62732422919d', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06390cd5-e8d2-4bc9-8df3-bb265320a9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:54 devstack sudo[104857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca 1073741824 Sep 04 16:05:54 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:54 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Volume volume-067395e6-122d-4583-88fd-62732422919d (067395e6-122d-4583-88fd-62732422919d): created successfully Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06390cd5-e8d2-4bc9-8df3-bb265320a9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Flow 'volume_create_manager' (93139954-4faf-40c6-956b-b3da0eacd0c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:54 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-e22aa7b4-19aa-458c-af35-dbed5c76cbcb tempest-ProjectReaderTests-283568500 None] Created volume successfully. Sep 04 16:05:54 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca 1073741824" returned: 0 in 0.500s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:55 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca Sep 04 16:05:55 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:55 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca" returned: 0 in 0.237s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:55 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:05:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bdda0d6-310f-420e-a4b2-048e43f2d331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81eae593-d733-47c3-b04a-285d2d138cca', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ebf9e9-905d-4148-921f-e58a83dcd5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:55 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Volume volume-81eae593-d733-47c3-b04a-285d2d138cca (81eae593-d733-47c3-b04a-285d2d138cca): created successfully Sep 04 16:05:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ebf9e9-905d-4148-921f-e58a83dcd5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Flow 'volume_create_manager' (28e5c487-229a-4bb7-abde-14283dd13566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:55 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-39baa0c7-bd6e-4f9f-9f3e-8888c8c2e548 tempest-SnapshotDependencyTests-324425626 None] Created volume successfully. Sep 04 16:05:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5612469f-f8f2-4f52-b644-3c89c741dd5b tempest-ProjectReaderTests-283568500 None] Acquiring lock "cinder-067395e6-122d-4583-88fd-62732422919d-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5612469f-f8f2-4f52-b644-3c89c741dd5b tempest-ProjectReaderTests-283568500 None] Lock "cinder-067395e6-122d-4583-88fd-62732422919d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5612469f-f8f2-4f52-b644-3c89c741dd5b tempest-ProjectReaderTests-283568500 None] Acquiring lock "cinder-quobyte-067395e6-122d-4583-88fd-62732422919d" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5612469f-f8f2-4f52-b644-3c89c741dd5b tempest-ProjectReaderTests-283568500 None] Lock "cinder-quobyte-067395e6-122d-4583-88fd-62732422919d" acquired by "delete_volume" :: waited 0.012s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:55 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[4096575f-9334-43bf-8284-3ec2935e03a0]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5612469f-f8f2-4f52-b644-3c89c741dd5b tempest-ProjectReaderTests-283568500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-067395e6-122d-4583-88fd-62732422919d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:55 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-067395e6-122d-4583-88fd-62732422919d Sep 04 16:05:55 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:56 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5612469f-f8f2-4f52-b644-3c89c741dd5b tempest-ProjectReaderTests-283568500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-067395e6-122d-4583-88fd-62732422919d" returned: 0 in 0.348s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5612469f-f8f2-4f52-b644-3c89c741dd5b tempest-ProjectReaderTests-283568500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-067395e6-122d-4583-88fd-62732422919d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:56 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-067395e6-122d-4583-88fd-62732422919d Sep 04 16:05:56 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:56 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5612469f-f8f2-4f52-b644-3c89c741dd5b tempest-ProjectReaderTests-283568500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-067395e6-122d-4583-88fd-62732422919d" returned: 0 in 0.282s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5612469f-f8f2-4f52-b644-3c89c741dd5b tempest-ProjectReaderTests-283568500 None] Lock "cinder-quobyte-067395e6-122d-4583-88fd-62732422919d" released by "delete_volume" :: held 0.682s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d87addbd-7ca8-43b8-825b-6aa92479187a tempest-SnapshotDependencyTests-324425626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d87addbd-7ca8-43b8-825b-6aa92479187a tempest-SnapshotDependencyTests-324425626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-d87addbd-7ca8-43b8-825b-6aa92479187a tempest-SnapshotDependencyTests-324425626 None] Creating offline snapshot d3728ae1-06d6-42c3-aeb2-7a358a6dcee2 of volume 81eae593-d733-47c3-b04a-285d2d138cca {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:05:56 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c494706-582b-409b-9f8b-a964a3eb788a]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d87addbd-7ca8-43b8-825b-6aa92479187a tempest-SnapshotDependencyTests-324425626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:56 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-5612469f-f8f2-4f52-b644-3c89c741dd5b tempest-ProjectReaderTests-283568500 None] Created reservations ['e7fe309d-9a97-409f-98cf-5d32f9a4f215', '7f54aec2-7319-4240-8cad-bda60d6eddaa', '7aedfcde-e21d-4d4a-8fe6-89450f8bf451', '0632234f-7006-4c00-9ef3-5389f49f2490'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:05:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5612469f-f8f2-4f52-b644-3c89c741dd5b tempest-ProjectReaderTests-283568500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5612469f-f8f2-4f52-b644-3c89c741dd5b tempest-ProjectReaderTests-283568500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-5612469f-f8f2-4f52-b644-3c89c741dd5b tempest-ProjectReaderTests-283568500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:05:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-5612469f-f8f2-4f52-b644-3c89c741dd5b tempest-ProjectReaderTests-283568500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:05:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5612469f-f8f2-4f52-b644-3c89c741dd5b tempest-ProjectReaderTests-283568500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5612469f-f8f2-4f52-b644-3c89c741dd5b tempest-ProjectReaderTests-283568500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:56 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:05:56 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:56 devstack sudo[104874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca Sep 04 16:05:56 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:56 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5612469f-f8f2-4f52-b644-3c89c741dd5b tempest-ProjectReaderTests-283568500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.259s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:56 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-5612469f-f8f2-4f52-b644-3c89c741dd5b tempest-ProjectReaderTests-283568500 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:05:56 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-5612469f-f8f2-4f52-b644-3c89c741dd5b tempest-ProjectReaderTests-283568500 None] Deleted volume successfully. Sep 04 16:05:56 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d87addbd-7ca8-43b8-825b-6aa92479187a tempest-SnapshotDependencyTests-324425626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca" returned: 0 in 0.375s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d87addbd-7ca8-43b8-825b-6aa92479187a tempest-SnapshotDependencyTests-324425626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.d3728ae1-06d6-42c3-aeb2-7a358a6dcee2 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5612469f-f8f2-4f52-b644-3c89c741dd5b tempest-ProjectReaderTests-283568500 None] Lock "cinder-067395e6-122d-4583-88fd-62732422919d-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:05:56 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.d3728ae1-06d6-42c3-aeb2-7a358a6dcee2 1G Sep 04 16:05:56 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:57 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:05:57 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Flow 'volume_create_manager' (7d16c183-6b2a-4948-91aa-a2e7eeb1f4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac07fa4-2b44-4961-a6ba-e6c28982f506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d87addbd-7ca8-43b8-825b-6aa92479187a tempest-SnapshotDependencyTests-324425626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.d3728ae1-06d6-42c3-aeb2-7a358a6dcee2 1G" returned: 0 in 0.475s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d87addbd-7ca8-43b8-825b-6aa92479187a tempest-SnapshotDependencyTests-324425626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81eae593-d733-47c3-b04a-285d2d138cca -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.d3728ae1-06d6-42c3-aeb2-7a358a6dcee2 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac07fa4-2b44-4961-a6ba-e6c28982f506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-620241058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec89a79-b62d-41e2-b53a-78070e3e4be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='523c6c4d0f2b4807a248e68e7a12d573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:57Z,use_quota=True,user_id='81a23e24815640848cc0a65783fd32a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:57 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81eae593-d733-47c3-b04a-285d2d138cca -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.d3728ae1-06d6-42c3-aeb2-7a358a6dcee2 Sep 04 16:05:57 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d1af056-9225-4dad-91d9-33751dc52e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d1af056-9225-4dad-91d9-33751dc52e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39ea9b9-f896-45ae-93cc-f384dcb7d4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39ea9b9-f896-45ae-93cc-f384dcb7d4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bec89a79-b62d-41e2-b53a-78070e3e4be4', 'volume_name': 'volume-bec89a79-b62d-41e2-b53a-78070e3e4be4', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3643c0-40cb-4c89-99ea-c22a92914dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3643c0-40cb-4c89-99ea-c22a92914dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2c7202-818d-4307-83ca-d931c54911bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:57 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Volume bec89a79-b62d-41e2-b53a-78070e3e4be4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bec89a79-b62d-41e2-b53a-78070e3e4be4', 'volume_size': 1} Sep 04 16:05:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:57 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d87addbd-7ca8-43b8-825b-6aa92479187a tempest-SnapshotDependencyTests-324425626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81eae593-d733-47c3-b04a-285d2d138cca -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.d3728ae1-06d6-42c3-aeb2-7a358a6dcee2" returned: 0 in 0.291s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:57 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-d87addbd-7ca8-43b8-825b-6aa92479187a tempest-SnapshotDependencyTests-324425626 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.d3728ae1-06d6-42c3-aeb2-7a358a6dcee2 is being set with open permissions: ugo+rw Sep 04 16:05:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d87addbd-7ca8-43b8-825b-6aa92479187a tempest-SnapshotDependencyTests-324425626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.d3728ae1-06d6-42c3-aeb2-7a358a6dcee2 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:57 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.d3728ae1-06d6-42c3-aeb2-7a358a6dcee2 Sep 04 16:05:57 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:57 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d87addbd-7ca8-43b8-825b-6aa92479187a tempest-SnapshotDependencyTests-324425626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.d3728ae1-06d6-42c3-aeb2-7a358a6dcee2" returned: 0 in 0.230s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d87addbd-7ca8-43b8-825b-6aa92479187a tempest-SnapshotDependencyTests-324425626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:57 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.info Sep 04 16:05:57 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:58 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d87addbd-7ca8-43b8-825b-6aa92479187a tempest-SnapshotDependencyTests-324425626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.info" returned: 0 in 0.235s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:58 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-d87addbd-7ca8-43b8-825b-6aa92479187a tempest-SnapshotDependencyTests-324425626 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.info is being set with open permissions: ugo+rw Sep 04 16:05:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d87addbd-7ca8-43b8-825b-6aa92479187a tempest-SnapshotDependencyTests-324425626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:58 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.info Sep 04 16:05:58 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:58 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d87addbd-7ca8-43b8-825b-6aa92479187a tempest-SnapshotDependencyTests-324425626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.info" returned: 0 in 0.252s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d87addbd-7ca8-43b8-825b-6aa92479187a tempest-SnapshotDependencyTests-324425626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.944s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-620241058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec89a79-b62d-41e2-b53a-78070e3e4be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='523c6c4d0f2b4807a248e68e7a12d573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:57Z,use_quota=True,user_id='81a23e24815640848cc0a65783fd32a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:05:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Creating volume bec89a79-b62d-41e2-b53a-78070e3e4be4 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:05:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:05:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:05:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:05:58 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:05:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bec89a79-b62d-41e2-b53a-78070e3e4be4 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:58 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bec89a79-b62d-41e2-b53a-78070e3e4be4 1073741824 Sep 04 16:05:58 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:58 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-d87addbd-7ca8-43b8-825b-6aa92479187a tempest-SnapshotDependencyTests-324425626 None] Create snapshot completed successfully Sep 04 16:05:58 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bec89a79-b62d-41e2-b53a-78070e3e4be4 1073741824" returned: 0 in 0.440s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bec89a79-b62d-41e2-b53a-78070e3e4be4 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:58 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bec89a79-b62d-41e2-b53a-78070e3e4be4 Sep 04 16:05:58 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:59 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bec89a79-b62d-41e2-b53a-78070e3e4be4" returned: 0 in 0.279s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2c7202-818d-4307-83ca-d931c54911bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bec89a79-b62d-41e2-b53a-78070e3e4be4', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a085af6a-f4b3-417e-998c-9e76e5bd0885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:59 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Volume volume-bec89a79-b62d-41e2-b53a-78070e3e4be4 (bec89a79-b62d-41e2-b53a-78070e3e4be4): created successfully Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a085af6a-f4b3-417e-998c-9e76e5bd0885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Flow 'volume_create_manager' (7d16c183-6b2a-4948-91aa-a2e7eeb1f4ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Flow 'volume_create_manager' (9ec651c6-153d-4de3-b5ab-c4bd8f9be0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85262dd3-14f1-499a-b756-52304fa786a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85262dd3-14f1-499a-b756-52304fa786a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eba1b44-0dd2-4087-be77-57c0edc76fa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f14e40f352e4b5dacea1c9d0f950e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d3728ae1-06d6-42c3-aeb2-7a358a6dcee2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:05:59Z,use_quota=True,user_id='db47506a13ac4f91b3f7bce6570b5f3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e639e3ad-b6f3-4792-adc6-6ce237d6cebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e639e3ad-b6f3-4792-adc6-6ce237d6cebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f861c2a-3e35-480e-8009-b2a5ee8ac12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f861c2a-3e35-480e-8009-b2a5ee8ac12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2eba1b44-0dd2-4087-be77-57c0edc76fa5', 'volume_name': 'volume-2eba1b44-0dd2-4087-be77-57c0edc76fa5', 'volume_size': 1, 'snapshot_id': 'd3728ae1-06d6-42c3-aeb2-7a358a6dcee2'}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5973a565-7667-42c7-aff9-6c2c71d1d732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5973a565-7667-42c7-aff9-6c2c71d1d732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347b6300-c7ed-40a9-a3b5-18fdb460a229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:05:59 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Volume 2eba1b44-0dd2-4087-be77-57c0edc76fa5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2eba1b44-0dd2-4087-be77-57c0edc76fa5', 'volume_size': 1, 'snapshot_id': 'd3728ae1-06d6-42c3-aeb2-7a358a6dcee2'} Sep 04 16:05:59 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-9949d992-73f9-4110-9708-da32970a23cd tempest-ProjectReaderTests-283568500 None] Created volume successfully. Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Acquiring lock "cinder-quobyte-d3728ae1-06d6-42c3-aeb2-7a358a6dcee2-2eba1b44-0dd2-4087-be77-57c0edc76fa5" by "_create_volume_from_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Lock "cinder-quobyte-d3728ae1-06d6-42c3-aeb2-7a358a6dcee2-2eba1b44-0dd2-4087-be77-57c0edc76fa5" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Creating volume 2eba1b44-0dd2-4087-be77-57c0edc76fa5 from snapshot d3728ae1-06d6-42c3-aeb2-7a358a6dcee2 {{(pid=87490) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Acquiring lock "cinder-quobyte-2eba1b44-0dd2-4087-be77-57c0edc76fa5" by "_copy_volume_from_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Lock "cinder-quobyte-2eba1b44-0dd2-4087-be77-57c0edc76fa5" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] snapshot: d3728ae1-06d6-42c3-aeb2-7a358a6dcee2, volume: 2eba1b44-0dd2-4087-be77-57c0edc76fa5, {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5671b60-125e-4301-96f9-939f67480617]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.d3728ae1-06d6-42c3-aeb2-7a358a6dcee2 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-922402f6-48f0-4c0f-8759-40e89c02ccde tempest-ProjectReaderTests-283568500 None] Acquiring lock "cinder-bec89a79-b62d-41e2-b53a-78070e3e4be4-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-922402f6-48f0-4c0f-8759-40e89c02ccde tempest-ProjectReaderTests-283568500 None] Lock "cinder-bec89a79-b62d-41e2-b53a-78070e3e4be4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:59 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.d3728ae1-06d6-42c3-aeb2-7a358a6dcee2 Sep 04 16:05:59 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-922402f6-48f0-4c0f-8759-40e89c02ccde tempest-ProjectReaderTests-283568500 None] Acquiring lock "cinder-quobyte-bec89a79-b62d-41e2-b53a-78070e3e4be4" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-922402f6-48f0-4c0f-8759-40e89c02ccde tempest-ProjectReaderTests-283568500 None] Lock "cinder-quobyte-bec89a79-b62d-41e2-b53a-78070e3e4be4" acquired by "delete_volume" :: waited 0.019s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[a961ed97-0d89-4831-a4cc-e4031cd19e7c]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-922402f6-48f0-4c0f-8759-40e89c02ccde tempest-ProjectReaderTests-283568500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bec89a79-b62d-41e2-b53a-78070e3e4be4 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:59 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bec89a79-b62d-41e2-b53a-78070e3e4be4 Sep 04 16:05:59 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:59 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.d3728ae1-06d6-42c3-aeb2-7a358a6dcee2" returned: 0 in 0.385s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81eae593-d733-47c3-b04a-285d2d138cca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c4f3c4-814a-4677-987f-02cfeda983bf]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:59 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-922402f6-48f0-4c0f-8759-40e89c02ccde tempest-ProjectReaderTests-283568500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bec89a79-b62d-41e2-b53a-78070e3e4be4" returned: 0 in 0.339s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:05:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-922402f6-48f0-4c0f-8759-40e89c02ccde tempest-ProjectReaderTests-283568500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bec89a79-b62d-41e2-b53a-78070e3e4be4 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:05:59 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca Sep 04 16:05:59 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:05:59 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bec89a79-b62d-41e2-b53a-78070e3e4be4 Sep 04 16:05:59 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:00 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-922402f6-48f0-4c0f-8759-40e89c02ccde tempest-ProjectReaderTests-283568500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bec89a79-b62d-41e2-b53a-78070e3e4be4" returned: 0 in 0.244s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-922402f6-48f0-4c0f-8759-40e89c02ccde tempest-ProjectReaderTests-283568500 None] Lock "cinder-quobyte-bec89a79-b62d-41e2-b53a-78070e3e4be4" released by "delete_volume" :: held 0.627s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:00 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca" returned: 0 in 0.386s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:00 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 16:06:00 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Creating direct copy from snapshot {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 16:06:00 devstack cinder-volume[87490]: DEBUG cinder.utils [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Path /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2eba1b44-0dd2-4087-be77-57c0edc76fa5 not found in is_blk_device check {{(pid=87490) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 16:06:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2eba1b44-0dd2-4087-be77-57c0edc76fa5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:00 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2eba1b44-0dd2-4087-be77-57c0edc76fa5 Sep 04 16:06:00 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:00 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-922402f6-48f0-4c0f-8759-40e89c02ccde tempest-ProjectReaderTests-283568500 None] Created reservations ['3aa8fa96-887d-467e-b667-26bd0015f01b', '69b0eb73-f5f8-4a6a-a01d-3e81a44d12ff', '68b6c9a2-1251-4ad4-8c00-9bf60465234e', 'c270f6df-1a0d-4f4b-b9af-34b4016aeec2'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:06:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-922402f6-48f0-4c0f-8759-40e89c02ccde tempest-ProjectReaderTests-283568500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-922402f6-48f0-4c0f-8759-40e89c02ccde tempest-ProjectReaderTests-283568500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:00 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-922402f6-48f0-4c0f-8759-40e89c02ccde tempest-ProjectReaderTests-283568500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:00 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-922402f6-48f0-4c0f-8759-40e89c02ccde tempest-ProjectReaderTests-283568500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-922402f6-48f0-4c0f-8759-40e89c02ccde tempest-ProjectReaderTests-283568500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-922402f6-48f0-4c0f-8759-40e89c02ccde tempest-ProjectReaderTests-283568500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:00 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:06:00 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:00 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-922402f6-48f0-4c0f-8759-40e89c02ccde tempest-ProjectReaderTests-283568500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.333s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:00 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-922402f6-48f0-4c0f-8759-40e89c02ccde tempest-ProjectReaderTests-283568500 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:06:00 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-922402f6-48f0-4c0f-8759-40e89c02ccde tempest-ProjectReaderTests-283568500 None] Deleted volume successfully. Sep 04 16:06:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-922402f6-48f0-4c0f-8759-40e89c02ccde tempest-ProjectReaderTests-283568500 None] Lock "cinder-bec89a79-b62d-41e2-b53a-78070e3e4be4-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:02 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:06:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Flow 'volume_create_manager' (d9e5d64b-57fa-49d0-94d8-63d4731ac307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dee9b3c-76ec-41e9-808f-a9e3e6ea26aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dee9b3c-76ec-41e9-808f-a9e3e6ea26aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-216144342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3db030b-0d88-4c77-bb7e-e998c3bc9c56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='523c6c4d0f2b4807a248e68e7a12d573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:02Z,use_quota=True,user_id='81a23e24815640848cc0a65783fd32a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aea70c5-e4f7-4197-b05a-ee5ade7c5256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aea70c5-e4f7-4197-b05a-ee5ade7c5256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac79fbbc-a537-45ec-9bac-256978ecfd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac79fbbc-a537-45ec-9bac-256978ecfd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3db030b-0d88-4c77-bb7e-e998c3bc9c56', 'volume_name': 'volume-a3db030b-0d88-4c77-bb7e-e998c3bc9c56', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3104dbc3-f4d7-450d-b17c-4fe2f737bb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3104dbc3-f4d7-450d-b17c-4fe2f737bb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86814b49-dccd-46c1-8720-081e7a592d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:02 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Volume a3db030b-0d88-4c77-bb7e-e998c3bc9c56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3db030b-0d88-4c77-bb7e-e998c3bc9c56', 'volume_size': 1} Sep 04 16:06:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:04 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2eba1b44-0dd2-4087-be77-57c0edc76fa5" returned: 0 in 4.245s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:04 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca, size 1024.00 MB, duration 4.25 sec, destination /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2eba1b44-0dd2-4087-be77-57c0edc76fa5 {{(pid=87490) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 16:06:04 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Converted 1024.00 MB image at 241.19 MB/s Sep 04 16:06:04 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2eba1b44-0dd2-4087-be77-57c0edc76fa5 is being set with open permissions: ugo+rw Sep 04 16:06:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2eba1b44-0dd2-4087-be77-57c0edc76fa5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:04 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2eba1b44-0dd2-4087-be77-57c0edc76fa5 Sep 04 16:06:04 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:04 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2eba1b44-0dd2-4087-be77-57c0edc76fa5" returned: 0 in 0.271s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:04 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Lock "cinder-quobyte-2eba1b44-0dd2-4087-be77-57c0edc76fa5" released by "_copy_volume_from_snapshot" :: held 5.366s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:04 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Lock "cinder-quobyte-d3728ae1-06d6-42c3-aeb2-7a358a6dcee2-2eba1b44-0dd2-4087-be77-57c0edc76fa5" released by "_create_volume_from_snapshot" :: held 5.424s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.444s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.066s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:04 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-216144342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3db030b-0d88-4c77-bb7e-e998c3bc9c56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='523c6c4d0f2b4807a248e68e7a12d573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:02Z,use_quota=True,user_id='81a23e24815640848cc0a65783fd32a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:06:04 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Creating volume a3db030b-0d88-4c77-bb7e-e998c3bc9c56 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:06:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:04 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:04 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:04 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:06:04 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:06:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a3db030b-0d88-4c77-bb7e-e998c3bc9c56 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347b6300-c7ed-40a9-a3b5-18fdb460a229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eba1b44-0dd2-4087-be77-57c0edc76fa5', 'volume_size': 1, 'snapshot_id': 'd3728ae1-06d6-42c3-aeb2-7a358a6dcee2'}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:04 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a3db030b-0d88-4c77-bb7e-e998c3bc9c56 1073741824 Sep 04 16:06:04 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd35310a-0e58-4144-9559-cf6464c988ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:04 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Volume volume-2eba1b44-0dd2-4087-be77-57c0edc76fa5 (2eba1b44-0dd2-4087-be77-57c0edc76fa5): created successfully Sep 04 16:06:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd35310a-0e58-4144-9559-cf6464c988ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:04 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Flow 'volume_create_manager' (9ec651c6-153d-4de3-b5ab-c4bd8f9be0ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:04 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-7354c61c-7b1b-480a-97f8-bab722b17a97 tempest-SnapshotDependencyTests-324425626 None] Created volume successfully. Sep 04 16:06:05 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a3db030b-0d88-4c77-bb7e-e998c3bc9c56 1073741824" returned: 0 in 0.418s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a3db030b-0d88-4c77-bb7e-e998c3bc9c56 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:05 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a3db030b-0d88-4c77-bb7e-e998c3bc9c56 Sep 04 16:06:05 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:05 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a3db030b-0d88-4c77-bb7e-e998c3bc9c56" returned: 0 in 0.230s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:05 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:06:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:05 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86814b49-dccd-46c1-8720-081e7a592d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3db030b-0d88-4c77-bb7e-e998c3bc9c56', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:05 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065a5014-f3ee-4d3d-8390-b4b32ee31620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:05 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Volume volume-a3db030b-0d88-4c77-bb7e-e998c3bc9c56 (a3db030b-0d88-4c77-bb7e-e998c3bc9c56): created successfully Sep 04 16:06:05 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065a5014-f3ee-4d3d-8390-b4b32ee31620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:05 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Flow 'volume_create_manager' (d9e5d64b-57fa-49d0-94d8-63d4731ac307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:05 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-672e18e2-b866-4b0e-8125-01adf1c5d16f tempest-ProjectReaderTests-283568500 None] Created volume successfully. Sep 04 16:06:05 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c7d74fa9-bd19-4104-aabe-d838c17218f0 tempest-SnapshotDependencyTests-324425626 None] Acquiring lock "cinder-d3728ae1-06d6-42c3-aeb2-7a358a6dcee2-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:05 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c7d74fa9-bd19-4104-aabe-d838c17218f0 tempest-SnapshotDependencyTests-324425626 None] Lock "cinder-d3728ae1-06d6-42c3-aeb2-7a358a6dcee2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:05 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c7d74fa9-bd19-4104-aabe-d838c17218f0 tempest-SnapshotDependencyTests-324425626 None] Acquiring lock "cinder-quobyte-81eae593-d733-47c3-b04a-285d2d138cca" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:05 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c7d74fa9-bd19-4104-aabe-d838c17218f0 tempest-SnapshotDependencyTests-324425626 None] Lock "cinder-quobyte-81eae593-d733-47c3-b04a-285d2d138cca" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:05 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c7d74fa9-bd19-4104-aabe-d838c17218f0 tempest-SnapshotDependencyTests-324425626 None] Acquiring lock "cinder-quobyte-d3728ae1-06d6-42c3-aeb2-7a358a6dcee2" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:05 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c7d74fa9-bd19-4104-aabe-d838c17218f0 tempest-SnapshotDependencyTests-324425626 None] Lock "cinder-quobyte-d3728ae1-06d6-42c3-aeb2-7a358a6dcee2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:05 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-c7d74fa9-bd19-4104-aabe-d838c17218f0 tempest-SnapshotDependencyTests-324425626 None] Deleting offline snapshot d3728ae1-06d6-42c3-aeb2-7a358a6dcee2 of volume 81eae593-d733-47c3-b04a-285d2d138cca {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:06:05 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-c7d74fa9-bd19-4104-aabe-d838c17218f0 tempest-SnapshotDependencyTests-324425626 None] snapshot_file for this snap is: volume-81eae593-d733-47c3-b04a-285d2d138cca.d3728ae1-06d6-42c3-aeb2-7a358a6dcee2 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:06:05 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28f4df7-5675-4b49-b0af-9a561567710f]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7d74fa9-bd19-4104-aabe-d838c17218f0 tempest-SnapshotDependencyTests-324425626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.d3728ae1-06d6-42c3-aeb2-7a358a6dcee2 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:05 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.d3728ae1-06d6-42c3-aeb2-7a358a6dcee2 Sep 04 16:06:05 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:06 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7d74fa9-bd19-4104-aabe-d838c17218f0 tempest-SnapshotDependencyTests-324425626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.d3728ae1-06d6-42c3-aeb2-7a358a6dcee2" returned: 0 in 0.363s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:06 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-c7d74fa9-bd19-4104-aabe-d838c17218f0 tempest-SnapshotDependencyTests-324425626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81eae593-d733-47c3-b04a-285d2d138cca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:06:06 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[6031ab89-7982-4a42-8418-2fe573dfb671]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7d74fa9-bd19-4104-aabe-d838c17218f0 tempest-SnapshotDependencyTests-324425626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:06 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca Sep 04 16:06:06 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b182f519-3cf7-4a2b-90bc-ed69ee8eb50a tempest-ProjectReaderTests-283568500 None] Acquiring lock "cinder-a3db030b-0d88-4c77-bb7e-e998c3bc9c56-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b182f519-3cf7-4a2b-90bc-ed69ee8eb50a tempest-ProjectReaderTests-283568500 None] Lock "cinder-a3db030b-0d88-4c77-bb7e-e998c3bc9c56-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b182f519-3cf7-4a2b-90bc-ed69ee8eb50a tempest-ProjectReaderTests-283568500 None] Acquiring lock "cinder-quobyte-a3db030b-0d88-4c77-bb7e-e998c3bc9c56" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b182f519-3cf7-4a2b-90bc-ed69ee8eb50a tempest-ProjectReaderTests-283568500 None] Lock "cinder-quobyte-a3db030b-0d88-4c77-bb7e-e998c3bc9c56" acquired by "delete_volume" :: waited 0.020s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:06 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e97da6-ff99-45a0-a8b9-fb16df72f7c3]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b182f519-3cf7-4a2b-90bc-ed69ee8eb50a tempest-ProjectReaderTests-283568500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a3db030b-0d88-4c77-bb7e-e998c3bc9c56 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:06 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a3db030b-0d88-4c77-bb7e-e998c3bc9c56 Sep 04 16:06:06 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:06 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7d74fa9-bd19-4104-aabe-d838c17218f0 tempest-SnapshotDependencyTests-324425626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca" returned: 0 in 0.549s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7d74fa9-bd19-4104-aabe-d838c17218f0 tempest-SnapshotDependencyTests-324425626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.d3728ae1-06d6-42c3-aeb2-7a358a6dcee2 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:06 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.d3728ae1-06d6-42c3-aeb2-7a358a6dcee2 Sep 04 16:06:06 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:06 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b182f519-3cf7-4a2b-90bc-ed69ee8eb50a tempest-ProjectReaderTests-283568500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a3db030b-0d88-4c77-bb7e-e998c3bc9c56" returned: 0 in 0.355s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b182f519-3cf7-4a2b-90bc-ed69ee8eb50a tempest-ProjectReaderTests-283568500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a3db030b-0d88-4c77-bb7e-e998c3bc9c56 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:06 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a3db030b-0d88-4c77-bb7e-e998c3bc9c56 Sep 04 16:06:06 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:07 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7d74fa9-bd19-4104-aabe-d838c17218f0 tempest-SnapshotDependencyTests-324425626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.d3728ae1-06d6-42c3-aeb2-7a358a6dcee2" returned: 0 in 0.328s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7d74fa9-bd19-4104-aabe-d838c17218f0 tempest-SnapshotDependencyTests-324425626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.d3728ae1-06d6-42c3-aeb2-7a358a6dcee2 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:07 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.d3728ae1-06d6-42c3-aeb2-7a358a6dcee2 Sep 04 16:06:07 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:07 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b182f519-3cf7-4a2b-90bc-ed69ee8eb50a tempest-ProjectReaderTests-283568500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-a3db030b-0d88-4c77-bb7e-e998c3bc9c56" returned: 0 in 0.244s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b182f519-3cf7-4a2b-90bc-ed69ee8eb50a tempest-ProjectReaderTests-283568500 None] Lock "cinder-quobyte-a3db030b-0d88-4c77-bb7e-e998c3bc9c56" released by "delete_volume" :: held 0.639s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:07 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-b182f519-3cf7-4a2b-90bc-ed69ee8eb50a tempest-ProjectReaderTests-283568500 None] Created reservations ['71371e17-014a-4504-bed6-b0c8208b31b5', '5153bc90-bb4a-472e-adf9-cb96067ffab0', 'e119e849-50ab-4f99-a408-f0f7900db418', '0e3ba817-ae38-4fff-93b3-b6e88214ec6b'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:06:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b182f519-3cf7-4a2b-90bc-ed69ee8eb50a tempest-ProjectReaderTests-283568500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b182f519-3cf7-4a2b-90bc-ed69ee8eb50a tempest-ProjectReaderTests-283568500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:07 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b182f519-3cf7-4a2b-90bc-ed69ee8eb50a tempest-ProjectReaderTests-283568500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:07 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b182f519-3cf7-4a2b-90bc-ed69ee8eb50a tempest-ProjectReaderTests-283568500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b182f519-3cf7-4a2b-90bc-ed69ee8eb50a tempest-ProjectReaderTests-283568500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b182f519-3cf7-4a2b-90bc-ed69ee8eb50a tempest-ProjectReaderTests-283568500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:07 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:06:07 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:07 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c7d74fa9-bd19-4104-aabe-d838c17218f0 tempest-SnapshotDependencyTests-324425626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca.d3728ae1-06d6-42c3-aeb2-7a358a6dcee2" returned: 0 in 0.271s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c7d74fa9-bd19-4104-aabe-d838c17218f0 tempest-SnapshotDependencyTests-324425626 None] Lock "cinder-quobyte-d3728ae1-06d6-42c3-aeb2-7a358a6dcee2" released by "_delete_snapshot" :: held 1.610s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c7d74fa9-bd19-4104-aabe-d838c17218f0 tempest-SnapshotDependencyTests-324425626 None] Lock "cinder-quobyte-81eae593-d733-47c3-b04a-285d2d138cca" released by "delete_snapshot" :: held 1.629s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:07 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-c7d74fa9-bd19-4104-aabe-d838c17218f0 tempest-SnapshotDependencyTests-324425626 None] Created reservations ['4688fd22-3c45-4414-b92d-c8e5cd61c559', '0617f64f-0121-4a8b-b03d-466702c0cd34', '8267ffdf-7ea6-4074-bcc3-0128406698ca', '45195808-a61b-4745-817f-de49da56d589'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:06:07 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:07 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-c7d74fa9-bd19-4104-aabe-d838c17218f0 tempest-SnapshotDependencyTests-324425626 None] Delete snapshot completed successfully. Sep 04 16:06:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b182f519-3cf7-4a2b-90bc-ed69ee8eb50a tempest-ProjectReaderTests-283568500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.247s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:07 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-b182f519-3cf7-4a2b-90bc-ed69ee8eb50a tempest-ProjectReaderTests-283568500 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:06:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c7d74fa9-bd19-4104-aabe-d838c17218f0 tempest-SnapshotDependencyTests-324425626 None] Lock "cinder-d3728ae1-06d6-42c3-aeb2-7a358a6dcee2-delete_snapshot" released by "delete_snapshot" :: held 1.757s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:07 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-b182f519-3cf7-4a2b-90bc-ed69ee8eb50a tempest-ProjectReaderTests-283568500 None] Deleted volume successfully. Sep 04 16:06:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b182f519-3cf7-4a2b-90bc-ed69ee8eb50a tempest-ProjectReaderTests-283568500 None] Lock "cinder-a3db030b-0d88-4c77-bb7e-e998c3bc9c56-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4eab56ad-605e-41c4-a63f-23cd18679137 tempest-SnapshotDependencyTests-324425626 None] Acquiring lock "cinder-81eae593-d733-47c3-b04a-285d2d138cca-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4eab56ad-605e-41c4-a63f-23cd18679137 tempest-SnapshotDependencyTests-324425626 None] Lock "cinder-81eae593-d733-47c3-b04a-285d2d138cca-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4eab56ad-605e-41c4-a63f-23cd18679137 tempest-SnapshotDependencyTests-324425626 None] Acquiring lock "cinder-quobyte-81eae593-d733-47c3-b04a-285d2d138cca" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4eab56ad-605e-41c4-a63f-23cd18679137 tempest-SnapshotDependencyTests-324425626 None] Lock "cinder-quobyte-81eae593-d733-47c3-b04a-285d2d138cca" acquired by "delete_volume" :: waited 0.013s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:07 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[868e7ca1-8ba9-4ac8-870c-e02752e092b2]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4eab56ad-605e-41c4-a63f-23cd18679137 tempest-SnapshotDependencyTests-324425626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:08 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca Sep 04 16:06:08 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:08 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4eab56ad-605e-41c4-a63f-23cd18679137 tempest-SnapshotDependencyTests-324425626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca" returned: 0 in 0.372s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4eab56ad-605e-41c4-a63f-23cd18679137 tempest-SnapshotDependencyTests-324425626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:08 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca Sep 04 16:06:08 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:08 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4eab56ad-605e-41c4-a63f-23cd18679137 tempest-SnapshotDependencyTests-324425626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-81eae593-d733-47c3-b04a-285d2d138cca" returned: 0 in 0.280s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:08 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4eab56ad-605e-41c4-a63f-23cd18679137 tempest-SnapshotDependencyTests-324425626 None] Lock "cinder-quobyte-81eae593-d733-47c3-b04a-285d2d138cca" released by "delete_volume" :: held 0.712s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:08 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-4eab56ad-605e-41c4-a63f-23cd18679137 tempest-SnapshotDependencyTests-324425626 None] Created reservations ['c54c374c-0f42-4252-acc3-cd0c00ee5d9b', '0970a389-2475-4993-9e70-4494a1c1f71a', '6312ba80-d6f4-4ab5-b32e-1509275951b9', 'f895ea7c-8b4e-42cc-be0e-ed34b55943f8'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:06:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4eab56ad-605e-41c4-a63f-23cd18679137 tempest-SnapshotDependencyTests-324425626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4eab56ad-605e-41c4-a63f-23cd18679137 tempest-SnapshotDependencyTests-324425626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:08 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4eab56ad-605e-41c4-a63f-23cd18679137 tempest-SnapshotDependencyTests-324425626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:08 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4eab56ad-605e-41c4-a63f-23cd18679137 tempest-SnapshotDependencyTests-324425626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4eab56ad-605e-41c4-a63f-23cd18679137 tempest-SnapshotDependencyTests-324425626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4eab56ad-605e-41c4-a63f-23cd18679137 tempest-SnapshotDependencyTests-324425626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:08 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:06:08 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:09 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4eab56ad-605e-41c4-a63f-23cd18679137 tempest-SnapshotDependencyTests-324425626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.274s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:09 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-4eab56ad-605e-41c4-a63f-23cd18679137 tempest-SnapshotDependencyTests-324425626 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:06:09 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-86dfa2af-7a28-4d95-af7f-31b48a03ccd8 tempest-SnapshotDependencyTests-324425626 None] Acquiring lock "cinder-2eba1b44-0dd2-4087-be77-57c0edc76fa5-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:09 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-4eab56ad-605e-41c4-a63f-23cd18679137 tempest-SnapshotDependencyTests-324425626 None] Deleted volume successfully. Sep 04 16:06:09 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-86dfa2af-7a28-4d95-af7f-31b48a03ccd8 tempest-SnapshotDependencyTests-324425626 None] Lock "cinder-2eba1b44-0dd2-4087-be77-57c0edc76fa5-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:09 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4eab56ad-605e-41c4-a63f-23cd18679137 tempest-SnapshotDependencyTests-324425626 None] Lock "cinder-81eae593-d733-47c3-b04a-285d2d138cca-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:09 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-86dfa2af-7a28-4d95-af7f-31b48a03ccd8 tempest-SnapshotDependencyTests-324425626 None] Acquiring lock "cinder-quobyte-2eba1b44-0dd2-4087-be77-57c0edc76fa5" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:09 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-86dfa2af-7a28-4d95-af7f-31b48a03ccd8 tempest-SnapshotDependencyTests-324425626 None] Lock "cinder-quobyte-2eba1b44-0dd2-4087-be77-57c0edc76fa5" acquired by "delete_volume" :: waited 0.015s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:09 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b42c46-b212-400e-ba9b-c84f44e8c371]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-86dfa2af-7a28-4d95-af7f-31b48a03ccd8 tempest-SnapshotDependencyTests-324425626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2eba1b44-0dd2-4087-be77-57c0edc76fa5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:09 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2eba1b44-0dd2-4087-be77-57c0edc76fa5 Sep 04 16:06:09 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:09 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-86dfa2af-7a28-4d95-af7f-31b48a03ccd8 tempest-SnapshotDependencyTests-324425626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2eba1b44-0dd2-4087-be77-57c0edc76fa5" returned: 0 in 0.395s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-86dfa2af-7a28-4d95-af7f-31b48a03ccd8 tempest-SnapshotDependencyTests-324425626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2eba1b44-0dd2-4087-be77-57c0edc76fa5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:09 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2eba1b44-0dd2-4087-be77-57c0edc76fa5 Sep 04 16:06:09 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:09 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-86dfa2af-7a28-4d95-af7f-31b48a03ccd8 tempest-SnapshotDependencyTests-324425626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2eba1b44-0dd2-4087-be77-57c0edc76fa5" returned: 0 in 0.249s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:09 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-86dfa2af-7a28-4d95-af7f-31b48a03ccd8 tempest-SnapshotDependencyTests-324425626 None] Lock "cinder-quobyte-2eba1b44-0dd2-4087-be77-57c0edc76fa5" released by "delete_volume" :: held 0.683s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:09 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-86dfa2af-7a28-4d95-af7f-31b48a03ccd8 tempest-SnapshotDependencyTests-324425626 None] Created reservations ['bdb6df32-68e2-45a4-beee-45cc72b1fde3', '5069971e-5910-477b-835d-94b26ff27a3c', '5dbe6886-d855-4c4a-8d21-61781f2cc073', 'ef1c64d8-19cb-4771-964e-15ee31cbe851'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:06:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-86dfa2af-7a28-4d95-af7f-31b48a03ccd8 tempest-SnapshotDependencyTests-324425626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-86dfa2af-7a28-4d95-af7f-31b48a03ccd8 tempest-SnapshotDependencyTests-324425626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:09 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-86dfa2af-7a28-4d95-af7f-31b48a03ccd8 tempest-SnapshotDependencyTests-324425626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:09 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-86dfa2af-7a28-4d95-af7f-31b48a03ccd8 tempest-SnapshotDependencyTests-324425626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-86dfa2af-7a28-4d95-af7f-31b48a03ccd8 tempest-SnapshotDependencyTests-324425626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-86dfa2af-7a28-4d95-af7f-31b48a03ccd8 tempest-SnapshotDependencyTests-324425626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:10 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:06:10 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:10 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-86dfa2af-7a28-4d95-af7f-31b48a03ccd8 tempest-SnapshotDependencyTests-324425626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.248s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:10 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-86dfa2af-7a28-4d95-af7f-31b48a03ccd8 tempest-SnapshotDependencyTests-324425626 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:06:10 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-86dfa2af-7a28-4d95-af7f-31b48a03ccd8 tempest-SnapshotDependencyTests-324425626 None] Deleted volume successfully. Sep 04 16:06:10 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=116,cinder:INSERT=39,cinder:UPDATE=155,cinder:DELETE=11 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:06:10 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-86dfa2af-7a28-4d95-af7f-31b48a03ccd8 tempest-SnapshotDependencyTests-324425626 None] Lock "cinder-2eba1b44-0dd2-4087-be77-57c0edc76fa5-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:19 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=118,cinder:UPDATE=161,cinder:INSERT=39,cinder:DELETE=16 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:06:30 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:06:30 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Flow 'volume_create_manager' (452587cb-e65a-4e83-946c-0351ef64f6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:30 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8fd22b6-0994-4f1d-8f51-bec67c5ebaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:30 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8fd22b6-0994-4f1d-8f51-bec67c5ebaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-221931927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d175ebd-5199-4d31-a0a7-0283dcf42ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff64265c4d6a4e16a6c889ca3cc4129e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:31Z,use_quota=True,user_id='2d92c571a55f493bba9871735de4e36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:30 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8046d028-489d-40e2-bd80-1ac16ac67bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:30 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8046d028-489d-40e2-bd80-1ac16ac67bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:30 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f138d16-4adc-4de6-91ba-7458a96575a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:30 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f138d16-4adc-4de6-91ba-7458a96575a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d175ebd-5199-4d31-a0a7-0283dcf42ddc', 'volume_name': 'volume-2d175ebd-5199-4d31-a0a7-0283dcf42ddc', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:30 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72384b17-2f22-4c54-b3e8-27cbacadb5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:30 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72384b17-2f22-4c54-b3e8-27cbacadb5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:30 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c7e19e-4a75-4faf-905c-c8356aa1c996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:30 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Volume 2d175ebd-5199-4d31-a0a7-0283dcf42ddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d175ebd-5199-4d31-a0a7-0283dcf42ddc', 'volume_size': 1} Sep 04 16:06:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:30 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-221931927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d175ebd-5199-4d31-a0a7-0283dcf42ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff64265c4d6a4e16a6c889ca3cc4129e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:31Z,use_quota=True,user_id='2d92c571a55f493bba9871735de4e36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:06:30 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Creating volume 2d175ebd-5199-4d31-a0a7-0283dcf42ddc {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:06:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:30 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:30 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:30 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:06:30 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:06:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d175ebd-5199-4d31-a0a7-0283dcf42ddc 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:30 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d175ebd-5199-4d31-a0a7-0283dcf42ddc 1073741824 Sep 04 16:06:30 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:31 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:06:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Flow 'volume_create_manager' (0a5aaf14-07c4-4a3f-b43a-4d839e2d0824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea8ee152-9a12-48b5-8339-2a2638d6d5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea8ee152-9a12-48b5-8339-2a2638d6d5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-842022118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c9a185d-2c6c-4ccd-a3d2-04e6d132942e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff64265c4d6a4e16a6c889ca3cc4129e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:31Z,use_quota=True,user_id='2d92c571a55f493bba9871735de4e36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe1bd6e-15e9-48e4-941a-72603f32103f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe1bd6e-15e9-48e4-941a-72603f32103f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0369ffb4-f640-4443-87fd-2ff57d345d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0369ffb4-f640-4443-87fd-2ff57d345d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c9a185d-2c6c-4ccd-a3d2-04e6d132942e', 'volume_name': 'volume-5c9a185d-2c6c-4ccd-a3d2-04e6d132942e', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cdb8556-8e82-4c2c-b3e7-8429a5b64087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cdb8556-8e82-4c2c-b3e7-8429a5b64087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb6679b-7dce-4156-9b92-9e378b027215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:31 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Volume 5c9a185d-2c6c-4ccd-a3d2-04e6d132942e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c9a185d-2c6c-4ccd-a3d2-04e6d132942e', 'volume_size': 1} Sep 04 16:06:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:31 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d175ebd-5199-4d31-a0a7-0283dcf42ddc 1073741824" returned: 0 in 1.094s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d175ebd-5199-4d31-a0a7-0283dcf42ddc {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:31 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d175ebd-5199-4d31-a0a7-0283dcf42ddc Sep 04 16:06:31 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Flow 'volume_create_manager' (92ce774b-fee5-4ff1-9ef1-381c27508104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d43fcd-7ba5-40d1-9425-c8b515a0a345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:32 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Flow 'volume_create_manager' (fa83f282-62fc-4584-82dd-b44f496e43f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (498c6166-a790-441c-accf-a252952cbdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d175ebd-5199-4d31-a0a7-0283dcf42ddc" returned: 0 in 0.445s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.790s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-842022118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c9a185d-2c6c-4ccd-a3d2-04e6d132942e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff64265c4d6a4e16a6c889ca3cc4129e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:31Z,use_quota=True,user_id='2d92c571a55f493bba9871735de4e36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Creating volume 5c9a185d-2c6c-4ccd-a3d2-04e6d132942e {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:06:32 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5c9a185d-2c6c-4ccd-a3d2-04e6d132942e 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d43fcd-7ba5-40d1-9425-c8b515a0a345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-758662190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e530049f-5348-4d89-baa3-8a3ad7c1d8a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cd9093ec25c438bbbe266217a70fccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:32Z,use_quota=True,user_id='243a73bc3d0d4c5b9536441b0c8d49f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db08539-8159-40d0-a78d-2938ced349bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db08539-8159-40d0-a78d-2938ced349bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:32 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5c9a185d-2c6c-4ccd-a3d2-04e6d132942e 1073741824 Sep 04 16:06:32 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b585ee6-263c-4e64-922d-76f2c3f02f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b585ee6-263c-4e64-922d-76f2c3f02f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e530049f-5348-4d89-baa3-8a3ad7c1d8a6', 'volume_name': 'volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a519c8-e01f-42a7-8d04-9eca69117d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a519c8-e01f-42a7-8d04-9eca69117d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aab8e0d-7275-43cf-9a5b-6e268b663567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:32 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Volume e530049f-5348-4d89-baa3-8a3ad7c1d8a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6', 'volume_size': 1} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (498c6166-a790-441c-accf-a252952cbdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1194629892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c9c5d5-33df-4b8f-bdc6-aa5aef09f390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff64265c4d6a4e16a6c889ca3cc4129e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:32Z,use_quota=True,user_id='2d92c571a55f493bba9871735de4e36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9242e895-3b03-49da-b439-d3bcadea1bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9242e895-3b03-49da-b439-d3bcadea1bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e97d472-03e4-4fe6-a258-5f94419aeff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e97d472-03e4-4fe6-a258-5f94419aeff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76c9c5d5-33df-4b8f-bdc6-aa5aef09f390', 'volume_name': 'volume-76c9c5d5-33df-4b8f-bdc6-aa5aef09f390', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f86a5e05-1d68-4e23-90cc-44f45cfb57a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f86a5e05-1d68-4e23-90cc-44f45cfb57a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22612518-269c-40db-bc1c-82792615a9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:32 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Volume 76c9c5d5-33df-4b8f-bdc6-aa5aef09f390: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76c9c5d5-33df-4b8f-bdc6-aa5aef09f390', 'volume_size': 1} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c7e19e-4a75-4faf-905c-c8356aa1c996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d175ebd-5199-4d31-a0a7-0283dcf42ddc', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ceeba5-4490-47db-87a9-930e8224877e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:32 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Volume volume-2d175ebd-5199-4d31-a0a7-0283dcf42ddc (2d175ebd-5199-4d31-a0a7-0283dcf42ddc): created successfully Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ceeba5-4490-47db-87a9-930e8224877e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Flow 'volume_create_manager' (452587cb-e65a-4e83-946c-0351ef64f6ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Flow 'volume_create_manager' (c0ed4413-7cbd-4b89-a21c-b30b3ee36256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e50e49-fb46-4dd6-9db8-1162e2a6355c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:32 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-895dcd25-80ac-42ed-8f32-2be55b008af2 tempest-CreateVolumesFromImageTest-391852614 None] Created volume successfully. Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e50e49-fb46-4dd6-9db8-1162e2a6355c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-778883378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bab1e37-4164-461d-82e5-641ba52a0a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff64265c4d6a4e16a6c889ca3cc4129e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:32Z,use_quota=True,user_id='2d92c571a55f493bba9871735de4e36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c5a15e-0546-4f9b-a04f-2505698094c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c5a15e-0546-4f9b-a04f-2505698094c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac9721e5-e3bf-4153-baf1-cd04829780cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac9721e5-e3bf-4153-baf1-cd04829780cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bab1e37-4164-461d-82e5-641ba52a0a3b', 'volume_name': 'volume-2bab1e37-4164-461d-82e5-641ba52a0a3b', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742f6273-689e-4801-ae77-0a00e7a1cbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742f6273-689e-4801-ae77-0a00e7a1cbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae42335-5cf0-4c47-9d8b-239294f8ebd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:32 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Volume 2bab1e37-4164-461d-82e5-641ba52a0a3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bab1e37-4164-461d-82e5-641ba52a0a3b', 'volume_size': 1} Sep 04 16:06:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:33 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5c9a185d-2c6c-4ccd-a3d2-04e6d132942e 1073741824" returned: 0 in 0.657s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5c9a185d-2c6c-4ccd-a3d2-04e6d132942e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:33 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5c9a185d-2c6c-4ccd-a3d2-04e6d132942e Sep 04 16:06:33 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Flow 'volume_create_manager' (458a48a0-3c4b-4d49-a84b-04185e4f53be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3100698c-e805-4d65-8612-dbfc71a86543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3100698c-e805-4d65-8612-dbfc71a86543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-304590755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=204a03a7-d9e3-4f20-a04e-71ac30042c95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff64265c4d6a4e16a6c889ca3cc4129e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:33Z,use_quota=True,user_id='2d92c571a55f493bba9871735de4e36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b686e9-ff80-4265-ac6d-75cefffb5166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b686e9-ff80-4265-ac6d-75cefffb5166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4596bf-22d6-4f33-867f-c1ce7572412b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4596bf-22d6-4f33-867f-c1ce7572412b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '204a03a7-d9e3-4f20-a04e-71ac30042c95', 'volume_name': 'volume-204a03a7-d9e3-4f20-a04e-71ac30042c95', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:33 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1239a5b0-109d-4b97-9fa9-53f01278f7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1239a5b0-109d-4b97-9fa9-53f01278f7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0a05c2-bab8-448b-83e4-367b30fa7ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:33 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Volume 204a03a7-d9e3-4f20-a04e-71ac30042c95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-204a03a7-d9e3-4f20-a04e-71ac30042c95', 'volume_size': 1} Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5c9a185d-2c6c-4ccd-a3d2-04e6d132942e" returned: 0 in 0.323s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.941s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-758662190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e530049f-5348-4d89-baa3-8a3ad7c1d8a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cd9093ec25c438bbbe266217a70fccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:32Z,use_quota=True,user_id='243a73bc3d0d4c5b9536441b0c8d49f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Creating volume e530049f-5348-4d89-baa3-8a3ad7c1d8a6 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:06:33 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb6679b-7dce-4156-9b92-9e378b027215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c9a185d-2c6c-4ccd-a3d2-04e6d132942e', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8565ad5-b119-4ea5-a753-f3bf2ad8e762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:33 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6 1073741824 Sep 04 16:06:33 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:33 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Volume volume-5c9a185d-2c6c-4ccd-a3d2-04e6d132942e (5c9a185d-2c6c-4ccd-a3d2-04e6d132942e): created successfully Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8565ad5-b119-4ea5-a753-f3bf2ad8e762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Flow 'volume_create_manager' (0a5aaf14-07c4-4a3f-b43a-4d839e2d0824) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:33 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-4153e727-3684-4e3c-9267-b443b7ec8709 tempest-CreateVolumesFromImageTest-391852614 None] Created volume successfully. Sep 04 16:06:33 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6 1073741824" returned: 0 in 0.448s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:33 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6 Sep 04 16:06:33 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:34 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6" returned: 0 in 0.277s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:06:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.626s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1194629892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c9c5d5-33df-4b8f-bdc6-aa5aef09f390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff64265c4d6a4e16a6c889ca3cc4129e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:32Z,use_quota=True,user_id='2d92c571a55f493bba9871735de4e36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:06:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Creating volume 76c9c5d5-33df-4b8f-bdc6-aa5aef09f390 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:06:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:06:34 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:06:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-76c9c5d5-33df-4b8f-bdc6-aa5aef09f390 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aab8e0d-7275-43cf-9a5b-6e268b663567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6bec725-0b1f-41d7-ac62-b92f1878e954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:34 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-76c9c5d5-33df-4b8f-bdc6-aa5aef09f390 1073741824 Sep 04 16:06:34 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:34 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Volume volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6 (e530049f-5348-4d89-baa3-8a3ad7c1d8a6): created successfully Sep 04 16:06:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6bec725-0b1f-41d7-ac62-b92f1878e954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Flow 'volume_create_manager' (92ce774b-fee5-4ff1-9ef1-381c27508104) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:34 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-535c4633-65a1-44a2-ac3c-25bddaf48d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Created volume successfully. Sep 04 16:06:34 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-76c9c5d5-33df-4b8f-bdc6-aa5aef09f390 1073741824" returned: 0 in 0.534s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-76c9c5d5-33df-4b8f-bdc6-aa5aef09f390 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:34 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-76c9c5d5-33df-4b8f-bdc6-aa5aef09f390 Sep 04 16:06:34 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:35 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-76c9c5d5-33df-4b8f-bdc6-aa5aef09f390" returned: 0 in 0.367s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.367s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-778883378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bab1e37-4164-461d-82e5-641ba52a0a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff64265c4d6a4e16a6c889ca3cc4129e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:32Z,use_quota=True,user_id='2d92c571a55f493bba9871735de4e36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Creating volume 2bab1e37-4164-461d-82e5-641ba52a0a3b {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:06:35 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2bab1e37-4164-461d-82e5-641ba52a0a3b 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22612518-269c-40db-bc1c-82792615a9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76c9c5d5-33df-4b8f-bdc6-aa5aef09f390', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0940f9-0131-46b4-b76a-65519bfa1f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:35 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2bab1e37-4164-461d-82e5-641ba52a0a3b 1073741824 Sep 04 16:06:35 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:35 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Volume volume-76c9c5d5-33df-4b8f-bdc6-aa5aef09f390 (76c9c5d5-33df-4b8f-bdc6-aa5aef09f390): created successfully Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0940f9-0131-46b4-b76a-65519bfa1f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Flow 'volume_create_manager' (fa83f282-62fc-4584-82dd-b44f496e43f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:35 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-92472cb0-ddce-48af-bb84-491966f8ffa4 tempest-CreateVolumesFromImageTest-391852614 None] Created volume successfully. Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c146888d-e14d-41b6-9eb5-71c83394e20e tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:35 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2bab1e37-4164-461d-82e5-641ba52a0a3b 1073741824" returned: 0 in 0.519s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2bab1e37-4164-461d-82e5-641ba52a0a3b {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:35 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2bab1e37-4164-461d-82e5-641ba52a0a3b Sep 04 16:06:35 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Flow 'volume_create_manager' (98574f4a-3c29-4008-8cc1-b55b3f1b8a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (962afbbb-9131-4734-82e9-5feab890fc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (962afbbb-9131-4734-82e9-5feab890fc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf3b56b-53b0-4701-b390-580c4620f0eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f68433bdbc4c4daa00467b5e0f24fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:36Z,use_quota=True,user_id='c17ed5b7fb4d4c7b9677b03d32c55d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(351a4d37-8789-440a-8f98-2fa716221dc3),volume_type_id=351a4d37-8789-440a-8f98-2fa716221dc3)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (234f4a40-947d-49ef-8d75-8083ad661d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (234f4a40-947d-49ef-8d75-8083ad661d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd604881-67c8-4b00-bbaf-93f4e8a0e8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG cinder.image.glance [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Creating Keystone auth plugin from conf {{(pid=87490) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 16:06:35 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2bab1e37-4164-461d-82e5-641ba52a0a3b" returned: 0 in 0.252s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.562s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-304590755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=204a03a7-d9e3-4f20-a04e-71ac30042c95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff64265c4d6a4e16a6c889ca3cc4129e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:33Z,use_quota=True,user_id='2d92c571a55f493bba9871735de4e36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Creating volume 204a03a7-d9e3-4f20-a04e-71ac30042c95 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:06:35 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:06:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-204a03a7-d9e3-4f20-a04e-71ac30042c95 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:36 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-204a03a7-d9e3-4f20-a04e-71ac30042c95 1073741824 Sep 04 16:06:36 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:36 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae42335-5cf0-4c47-9d8b-239294f8ebd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bab1e37-4164-461d-82e5-641ba52a0a3b', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:36 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5bd242-cc92-46df-be83-ce0e33f78c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:36 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Volume volume-2bab1e37-4164-461d-82e5-641ba52a0a3b (2bab1e37-4164-461d-82e5-641ba52a0a3b): created successfully Sep 04 16:06:36 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5bd242-cc92-46df-be83-ce0e33f78c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:36 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Flow 'volume_create_manager' (c0ed4413-7cbd-4b89-a21c-b30b3ee36256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:36 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-1bed7ab8-5d91-41dd-9cff-645a13cf70d2 tempest-CreateVolumesFromImageTest-391852614 None] Created volume successfully. Sep 04 16:06:36 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd604881-67c8-4b00-bbaf-93f4e8a0e8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ebf3b56b-53b0-4701-b390-580c4620f0eb', 'volume_name': 'volume-ebf3b56b-53b0-4701-b390-580c4620f0eb', 'volume_size': 1, 'image_id': 'd2385e19-0030-4088-9b11-ac2ff8692e32', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d2385e19-0030-4088-9b11-ac2ff8692e32', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c82dee119a6f8e5fe4b3d3935c5a66df', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '03f68433bdbc4c4daa00467b5e0f24fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0a477c7d7d9ea3c22fca596a647a6bd3904e6b311484c809c67cedd70070ec3b84b0efb97603675cde9611ae24c30862efccbda8510b8ca17cb2b71b43d9c7fe', 'id': 'd2385e19-0030-4088-9b11-ac2ff8692e32', 'created_at': datetime.datetime(2026, 9, 4, 14, 6, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 6, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d2385e19-0030-4088-9b11-ac2ff8692e32/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:36 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3122e91-e1fa-4487-9afb-a53453491ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:36 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3122e91-e1fa-4487-9afb-a53453491ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:36 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d198e9-f15f-4429-b256-7806559058f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:36 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Volume ebf3b56b-53b0-4701-b390-580c4620f0eb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ebf3b56b-53b0-4701-b390-580c4620f0eb', 'volume_size': 1, 'image_id': 'd2385e19-0030-4088-9b11-ac2ff8692e32', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d2385e19-0030-4088-9b11-ac2ff8692e32', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c82dee119a6f8e5fe4b3d3935c5a66df', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '03f68433bdbc4c4daa00467b5e0f24fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0a477c7d7d9ea3c22fca596a647a6bd3904e6b311484c809c67cedd70070ec3b84b0efb97603675cde9611ae24c30862efccbda8510b8ca17cb2b71b43d9c7fe', 'id': 'd2385e19-0030-4088-9b11-ac2ff8692e32', 'created_at': datetime.datetime(2026, 9, 4, 14, 6, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 6, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d2385e19-0030-4088-9b11-ac2ff8692e32/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 04 16:06:36 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Trying to clone ebf3b56b-53b0-4701-b390-580c4620f0eb from image d2385e19-0030-4088-9b11-ac2ff8692e32 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d2385e19-0030-4088-9b11-ac2ff8692e32', 'metadata': {}}]). {{(pid=87490) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 16:06:36 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d2385e19-0030-4088-9b11-ac2ff8692e32_7qy6o4pzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 16:06:36 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Image download 0.00 MB at 0.00 MB/s Sep 04 16:06:36 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[7292899d-3b71-48ba-ad20-1a2ce893af31]: (4, 'raw') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d2385e19-0030-4088-9b11-ac2ff8692e32_7qy6o4pzdevstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:36 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d2385e19-0030-4088-9b11-ac2ff8692e32_7qy6o4pzdevstack@QuobyteHD Sep 04 16:06:36 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:36 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-204a03a7-d9e3-4f20-a04e-71ac30042c95 1073741824" returned: 0 in 0.601s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-204a03a7-d9e3-4f20-a04e-71ac30042c95 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:36 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-204a03a7-d9e3-4f20-a04e-71ac30042c95 Sep 04 16:06:36 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:36 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d2385e19-0030-4088-9b11-ac2ff8692e32_7qy6o4pzdevstack@QuobyteHD" returned: 0 in 0.406s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d2385e19-0030-4088-9b11-ac2ff8692e32_7qy6o4pzdevstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:36 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-204a03a7-d9e3-4f20-a04e-71ac30042c95" returned: 0 in 0.254s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:36 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:06:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c146888d-e14d-41b6-9eb5-71c83394e20e tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.576s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:36 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0a05c2-bab8-448b-83e4-367b30fa7ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-204a03a7-d9e3-4f20-a04e-71ac30042c95', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:36 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8085f88-01c9-4279-a454-45e3b6d24f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:36 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-c146888d-e14d-41b6-9eb5-71c83394e20e tempest-CreateVolumesFromSnapshotTest-1582167689 None] Creating offline snapshot 207943cc-2f79-412f-bf0a-c0725f51df27 of volume e530049f-5348-4d89-baa3-8a3ad7c1d8a6 {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:06:36 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Volume volume-204a03a7-d9e3-4f20-a04e-71ac30042c95 (204a03a7-d9e3-4f20-a04e-71ac30042c95): created successfully Sep 04 16:06:36 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8085f88-01c9-4279-a454-45e3b6d24f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:36 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Flow 'volume_create_manager' (458a48a0-3c4b-4d49-a84b-04185e4f53be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:36 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[301cc1f4-c421-434b-a855-eb46b33d2563]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c146888d-e14d-41b6-9eb5-71c83394e20e tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:36 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-840833b6-9432-4cf7-a412-fa79fe3f6bed tempest-CreateVolumesFromImageTest-391852614 None] Created volume successfully. Sep 04 16:06:37 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d2385e19-0030-4088-9b11-ac2ff8692e32_7qy6o4pzdevstack@QuobyteHD Sep 04 16:06:37 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:37 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6 Sep 04 16:06:37 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:37 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d2385e19-0030-4088-9b11-ac2ff8692e32_7qy6o4pzdevstack@QuobyteHD" returned: 1 in 0.399s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d2385e19-0030-4088-9b11-ac2ff8692e32_7qy6o4pzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:06:37 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Temporary image d2385e19-0030-4088-9b11-ac2ff8692e32 is fetched for user c17ed5b7fb4d4c7b9677b03d32c55d82. {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 16:06:37 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b5402c-8c41-4106-94c1-80d7ab8c9394]: (4, 'raw') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d2385e19-0030-4088-9b11-ac2ff8692e32_7qy6o4pzdevstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:37 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c146888d-e14d-41b6-9eb5-71c83394e20e tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6" returned: 0 in 0.385s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c146888d-e14d-41b6-9eb5-71c83394e20e tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6.207943cc-2f79-412f-bf0a-c0725f51df27 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:37 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6.207943cc-2f79-412f-bf0a-c0725f51df27 1G Sep 04 16:06:37 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:37 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d2385e19-0030-4088-9b11-ac2ff8692e32_7qy6o4pzdevstack@QuobyteHD Sep 04 16:06:37 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:37 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d2385e19-0030-4088-9b11-ac2ff8692e32_7qy6o4pzdevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d2385e19-0030-4088-9b11-ac2ff8692e32_7qy6o4pzdevstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:37 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2a4dfe88-e54c-49eb-8550-ae2b1ad14575 tempest-CreateVolumesFromImageTest-391852614 None] Acquiring lock "cinder-204a03a7-d9e3-4f20-a04e-71ac30042c95-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:37 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2a4dfe88-e54c-49eb-8550-ae2b1ad14575 tempest-CreateVolumesFromImageTest-391852614 None] Lock "cinder-204a03a7-d9e3-4f20-a04e-71ac30042c95-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:37 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2a4dfe88-e54c-49eb-8550-ae2b1ad14575 tempest-CreateVolumesFromImageTest-391852614 None] Acquiring lock "cinder-quobyte-204a03a7-d9e3-4f20-a04e-71ac30042c95" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:37 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2a4dfe88-e54c-49eb-8550-ae2b1ad14575 tempest-CreateVolumesFromImageTest-391852614 None] Lock "cinder-quobyte-204a03a7-d9e3-4f20-a04e-71ac30042c95" acquired by "delete_volume" :: waited 0.015s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:37 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[77635632-a482-4472-bc8a-d77990217067]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2a4dfe88-e54c-49eb-8550-ae2b1ad14575 tempest-CreateVolumesFromImageTest-391852614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-204a03a7-d9e3-4f20-a04e-71ac30042c95 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:37 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d2385e19-0030-4088-9b11-ac2ff8692e32_7qy6o4pzdevstack@QuobyteHD Sep 04 16:06:37 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:37 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c146888d-e14d-41b6-9eb5-71c83394e20e tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6.207943cc-2f79-412f-bf0a-c0725f51df27 1G" returned: 0 in 0.455s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c146888d-e14d-41b6-9eb5-71c83394e20e tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6.207943cc-2f79-412f-bf0a-c0725f51df27 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:37 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6.207943cc-2f79-412f-bf0a-c0725f51df27 Sep 04 16:06:37 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:37 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-204a03a7-d9e3-4f20-a04e-71ac30042c95 Sep 04 16:06:37 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:38 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d2385e19-0030-4088-9b11-ac2ff8692e32_7qy6o4pzdevstack@QuobyteHD" returned: 1 in 0.356s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d2385e19-0030-4088-9b11-ac2ff8692e32_7qy6o4pzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:38 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c146888d-e14d-41b6-9eb5-71c83394e20e tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6.207943cc-2f79-412f-bf0a-c0725f51df27" returned: 0 in 0.335s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:38 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-c146888d-e14d-41b6-9eb5-71c83394e20e tempest-CreateVolumesFromSnapshotTest-1582167689 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6.207943cc-2f79-412f-bf0a-c0725f51df27 is being set with open permissions: ugo+rw Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c146888d-e14d-41b6-9eb5-71c83394e20e tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6.207943cc-2f79-412f-bf0a-c0725f51df27 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:38 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2a4dfe88-e54c-49eb-8550-ae2b1ad14575 tempest-CreateVolumesFromImageTest-391852614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-204a03a7-d9e3-4f20-a04e-71ac30042c95" returned: 0 in 0.384s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2a4dfe88-e54c-49eb-8550-ae2b1ad14575 tempest-CreateVolumesFromImageTest-391852614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-204a03a7-d9e3-4f20-a04e-71ac30042c95 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:38 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6.207943cc-2f79-412f-bf0a-c0725f51df27 Sep 04 16:06:38 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:38 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-204a03a7-d9e3-4f20-a04e-71ac30042c95 Sep 04 16:06:38 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:38 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:06:38 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:38 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2a4dfe88-e54c-49eb-8550-ae2b1ad14575 tempest-CreateVolumesFromImageTest-391852614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-204a03a7-d9e3-4f20-a04e-71ac30042c95" returned: 0 in 0.281s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:38 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2a4dfe88-e54c-49eb-8550-ae2b1ad14575 tempest-CreateVolumesFromImageTest-391852614 None] Lock "cinder-quobyte-204a03a7-d9e3-4f20-a04e-71ac30042c95" released by "delete_volume" :: held 0.715s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c146888d-e14d-41b6-9eb5-71c83394e20e tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6.207943cc-2f79-412f-bf0a-c0725f51df27" returned: 0 in 0.338s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:38 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.289s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c146888d-e14d-41b6-9eb5-71c83394e20e tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager._thread_info {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread count: 28 {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread info: [<_MainThread(MainThread, started 138899118923904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 16:06:38 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6.info Sep 04 16:06:38 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-2a4dfe88-e54c-49eb-8550-ae2b1ad14575 tempest-CreateVolumesFromImageTest-391852614 None] Created reservations ['a7b461e2-9f2a-407b-9366-100259ba9102', '17cafc41-5956-4b99-8834-b983970c6afb', '435ad602-6404-4864-8dfd-f46fe1a486d9', '1185771d-29c1-4d56-9160-5fcc63a0b70b'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2a4dfe88-e54c-49eb-8550-ae2b1ad14575 tempest-CreateVolumesFromImageTest-391852614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2a4dfe88-e54c-49eb-8550-ae2b1ad14575 tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2a4dfe88-e54c-49eb-8550-ae2b1ad14575 tempest-CreateVolumesFromImageTest-391852614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2a4dfe88-e54c-49eb-8550-ae2b1ad14575 tempest-CreateVolumesFromImageTest-391852614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2a4dfe88-e54c-49eb-8550-ae2b1ad14575 tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2a4dfe88-e54c-49eb-8550-ae2b1ad14575 tempest-CreateVolumesFromImageTest-391852614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:38 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:06:38 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:38 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c146888d-e14d-41b6-9eb5-71c83394e20e tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6.info" returned: 0 in 0.279s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:38 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-c146888d-e14d-41b6-9eb5-71c83394e20e tempest-CreateVolumesFromSnapshotTest-1582167689 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6.info is being set with open permissions: ugo+rw Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c146888d-e14d-41b6-9eb5-71c83394e20e tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:38 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6.info Sep 04 16:06:38 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-10d03137-24e6-46d6-b460-3a56985f911e tempest-CreateVolumesFromImageTest-391852614 None] Acquiring lock "cinder-2bab1e37-4164-461d-82e5-641ba52a0a3b-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-10d03137-24e6-46d6-b460-3a56985f911e tempest-CreateVolumesFromImageTest-391852614 None] Lock "cinder-2bab1e37-4164-461d-82e5-641ba52a0a3b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:38 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2a4dfe88-e54c-49eb-8550-ae2b1ad14575 tempest-CreateVolumesFromImageTest-391852614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.284s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-2a4dfe88-e54c-49eb-8550-ae2b1ad14575 tempest-CreateVolumesFromImageTest-391852614 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:06:38 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-2a4dfe88-e54c-49eb-8550-ae2b1ad14575 tempest-CreateVolumesFromImageTest-391852614 None] Deleted volume successfully. Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-10d03137-24e6-46d6-b460-3a56985f911e tempest-CreateVolumesFromImageTest-391852614 None] Acquiring lock "cinder-quobyte-2bab1e37-4164-461d-82e5-641ba52a0a3b" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:38 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2a4dfe88-e54c-49eb-8550-ae2b1ad14575 tempest-CreateVolumesFromImageTest-391852614 None] Lock "cinder-204a03a7-d9e3-4f20-a04e-71ac30042c95-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:39 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-10d03137-24e6-46d6-b460-3a56985f911e tempest-CreateVolumesFromImageTest-391852614 None] Lock "cinder-quobyte-2bab1e37-4164-461d-82e5-641ba52a0a3b" acquired by "delete_volume" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:39 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba423c41-6d67-4911-87ab-bab8e1d260d0]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-10d03137-24e6-46d6-b460-3a56985f911e tempest-CreateVolumesFromImageTest-391852614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2bab1e37-4164-461d-82e5-641ba52a0a3b {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:39 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2bab1e37-4164-461d-82e5-641ba52a0a3b Sep 04 16:06:39 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:39 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c146888d-e14d-41b6-9eb5-71c83394e20e tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6.info" returned: 0 in 0.367s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c146888d-e14d-41b6-9eb5-71c83394e20e tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.313s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.185s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf3b56b-53b0-4701-b390-580c4620f0eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f68433bdbc4c4daa00467b5e0f24fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:36Z,use_quota=True,user_id='c17ed5b7fb4d4c7b9677b03d32c55d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(351a4d37-8789-440a-8f98-2fa716221dc3),volume_type_id=351a4d37-8789-440a-8f98-2fa716221dc3)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:06:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Creating volume ebf3b56b-53b0-4701-b390-580c4620f0eb {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:06:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:06:39 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:06:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ebf3b56b-53b0-4701-b390-580c4620f0eb 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:39 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ebf3b56b-53b0-4701-b390-580c4620f0eb 1073741824 Sep 04 16:06:39 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:39 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-c146888d-e14d-41b6-9eb5-71c83394e20e tempest-CreateVolumesFromSnapshotTest-1582167689 None] Create snapshot completed successfully Sep 04 16:06:39 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-10d03137-24e6-46d6-b460-3a56985f911e tempest-CreateVolumesFromImageTest-391852614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2bab1e37-4164-461d-82e5-641ba52a0a3b" returned: 0 in 0.386s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-10d03137-24e6-46d6-b460-3a56985f911e tempest-CreateVolumesFromImageTest-391852614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2bab1e37-4164-461d-82e5-641ba52a0a3b {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:39 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2bab1e37-4164-461d-82e5-641ba52a0a3b Sep 04 16:06:39 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:39 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:39 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ebf3b56b-53b0-4701-b390-580c4620f0eb 1073741824" returned: 0 in 0.529s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-10d03137-24e6-46d6-b460-3a56985f911e tempest-CreateVolumesFromImageTest-391852614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2bab1e37-4164-461d-82e5-641ba52a0a3b" returned: 0 in 0.325s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:39 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-10d03137-24e6-46d6-b460-3a56985f911e tempest-CreateVolumesFromImageTest-391852614 None] Lock "cinder-quobyte-2bab1e37-4164-461d-82e5-641ba52a0a3b" released by "delete_volume" :: held 0.775s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ebf3b56b-53b0-4701-b390-580c4620f0eb {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:39 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ebf3b56b-53b0-4701-b390-580c4620f0eb Sep 04 16:06:39 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:39 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-10d03137-24e6-46d6-b460-3a56985f911e tempest-CreateVolumesFromImageTest-391852614 None] Created reservations ['78d01877-d84b-4595-82c2-f32a249b2ff8', '600cce25-f3d7-48ab-be38-4a795d1d6be3', '4cc98bd6-9150-42ba-9be1-c21429212c47', 'b76a53f1-d974-4be5-8c1d-4a3c86fbc6b5'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-10d03137-24e6-46d6-b460-3a56985f911e tempest-CreateVolumesFromImageTest-391852614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-10d03137-24e6-46d6-b460-3a56985f911e tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-10d03137-24e6-46d6-b460-3a56985f911e tempest-CreateVolumesFromImageTest-391852614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-10d03137-24e6-46d6-b460-3a56985f911e tempest-CreateVolumesFromImageTest-391852614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-10d03137-24e6-46d6-b460-3a56985f911e tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-10d03137-24e6-46d6-b460-3a56985f911e tempest-CreateVolumesFromImageTest-391852614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:40 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:06:40 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:40 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ebf3b56b-53b0-4701-b390-580c4620f0eb" returned: 0 in 0.438s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1266e396-0675-4199-aa48-0a65e24f9f51 tempest-CreateVolumesFromImageTest-391852614 None] Acquiring lock "cinder-76c9c5d5-33df-4b8f-bdc6-aa5aef09f390-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Attempting download of d2385e19-0030-4088-9b11-ac2ff8692e32 ((None, [{'url': 'file:///opt/stack/data/glance/images/d2385e19-0030-4088-9b11-ac2ff8692e32', 'metadata': {}}])) to volume ebf3b56b-53b0-4701-b390-580c4620f0eb. {{(pid=87490) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1266e396-0675-4199-aa48-0a65e24f9f51 tempest-CreateVolumesFromImageTest-391852614 None] Lock "cinder-76c9c5d5-33df-4b8f-bdc6-aa5aef09f390-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Flow 'volume_create_manager' (ef630f6c-89fb-4de7-ae03-4e27debe02dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7b1794-7a8d-48c9-87d3-1d6ca4c028dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d963e6f-87f6-4dba-8783-8dece7b52ff8]: (4, 'raw') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d2385e19-0030-4088-9b11-ac2ff8692e32_k7b5vhjs {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7b1794-7a8d-48c9-87d3-1d6ca4c028dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-754838959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd542483-e960-45e1-8e8c-29d0b4fe4c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cd9093ec25c438bbbe266217a70fccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:40Z,use_quota=True,user_id='243a73bc3d0d4c5b9536441b0c8d49f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0e225c-10f2-49e8-8efd-75b01a260c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0e225c-10f2-49e8-8efd-75b01a260c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:40 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ffc4fb0-bce8-427a-9a3f-d771887909f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ffc4fb0-bce8-427a-9a3f-d771887909f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd542483-e960-45e1-8e8c-29d0b4fe4c20', 'volume_name': 'volume-fd542483-e960-45e1-8e8c-29d0b4fe4c20', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b06f92-c73b-4af1-87a8-dd74e053e982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b06f92-c73b-4af1-87a8-dd74e053e982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394a86d1-5bcb-488e-ab6a-6e9bdb5e4176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:40 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Volume fd542483-e960-45e1-8e8c-29d0b4fe4c20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd542483-e960-45e1-8e8c-29d0b4fe4c20', 'volume_size': 1} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-754838959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd542483-e960-45e1-8e8c-29d0b4fe4c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cd9093ec25c438bbbe266217a70fccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:40Z,use_quota=True,user_id='243a73bc3d0d4c5b9536441b0c8d49f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Creating volume fd542483-e960-45e1-8e8c-29d0b4fe4c20 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:06:40 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd542483-e960-45e1-8e8c-29d0b4fe4c20 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-10d03137-24e6-46d6-b460-3a56985f911e tempest-CreateVolumesFromImageTest-391852614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.607s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-10d03137-24e6-46d6-b460-3a56985f911e tempest-CreateVolumesFromImageTest-391852614 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:06:40 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d2385e19-0030-4088-9b11-ac2ff8692e32_k7b5vhjs Sep 04 16:06:40 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:40 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-10d03137-24e6-46d6-b460-3a56985f911e tempest-CreateVolumesFromImageTest-391852614 None] Deleted volume successfully. Sep 04 16:06:40 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd542483-e960-45e1-8e8c-29d0b4fe4c20 1073741824 Sep 04 16:06:40 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1266e396-0675-4199-aa48-0a65e24f9f51 tempest-CreateVolumesFromImageTest-391852614 None] Acquiring lock "cinder-quobyte-76c9c5d5-33df-4b8f-bdc6-aa5aef09f390" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-10d03137-24e6-46d6-b460-3a56985f911e tempest-CreateVolumesFromImageTest-391852614 None] Lock "cinder-2bab1e37-4164-461d-82e5-641ba52a0a3b-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1266e396-0675-4199-aa48-0a65e24f9f51 tempest-CreateVolumesFromImageTest-391852614 None] Lock "cinder-quobyte-76c9c5d5-33df-4b8f-bdc6-aa5aef09f390" acquired by "delete_volume" :: waited 0.063s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[a690633d-8f0d-43c1-b4a7-840600c7d61c]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1266e396-0675-4199-aa48-0a65e24f9f51 tempest-CreateVolumesFromImageTest-391852614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-76c9c5d5-33df-4b8f-bdc6-aa5aef09f390 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:40 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-76c9c5d5-33df-4b8f-bdc6-aa5aef09f390 Sep 04 16:06:40 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:41 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d2385e19-0030-4088-9b11-ac2ff8692e32_k7b5vhjs" returned: 0 in 0.558s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d2385e19-0030-4088-9b11-ac2ff8692e32_k7b5vhjs {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Flow 'volume_create_manager' (76476a4c-d8ac-4225-b132-6a08fc412e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32b7df2b-7134-4623-a71a-8bfea395f34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:41 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d2385e19-0030-4088-9b11-ac2ff8692e32_k7b5vhjs Sep 04 16:06:41 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32b7df2b-7134-4623-a71a-8bfea395f34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-315371171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309f4ab9-855c-4d67-9dc4-a13c50ee0288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cd9093ec25c438bbbe266217a70fccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:41Z,use_quota=True,user_id='243a73bc3d0d4c5b9536441b0c8d49f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:41 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e05b38a-45f0-4a28-b21c-76128bf44866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e05b38a-45f0-4a28-b21c-76128bf44866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c1946e-e8b4-4a27-bee9-0118e563c73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c1946e-e8b4-4a27-bee9-0118e563c73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '309f4ab9-855c-4d67-9dc4-a13c50ee0288', 'volume_name': 'volume-309f4ab9-855c-4d67-9dc4-a13c50ee0288', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d11cb4-c842-4771-99af-a828d4e95beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d11cb4-c842-4771-99af-a828d4e95beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (457161af-11cc-4d33-8fa4-468f4d9182fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:41 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Volume 309f4ab9-855c-4d67-9dc4-a13c50ee0288: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-309f4ab9-855c-4d67-9dc4-a13c50ee0288', 'volume_size': 1} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd542483-e960-45e1-8e8c-29d0b4fe4c20 1073741824" returned: 0 in 0.759s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd542483-e960-45e1-8e8c-29d0b4fe4c20 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:41 devstack sudo[105248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd542483-e960-45e1-8e8c-29d0b4fe4c20 Sep 04 16:06:41 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:41 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1266e396-0675-4199-aa48-0a65e24f9f51 tempest-CreateVolumesFromImageTest-391852614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-76c9c5d5-33df-4b8f-bdc6-aa5aef09f390" returned: 0 in 0.728s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1266e396-0675-4199-aa48-0a65e24f9f51 tempest-CreateVolumesFromImageTest-391852614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-76c9c5d5-33df-4b8f-bdc6-aa5aef09f390 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:41 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-76c9c5d5-33df-4b8f-bdc6-aa5aef09f390 Sep 04 16:06:41 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:06:41 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Flow 'volume_create_manager' (1bf860dd-7357-4ae0-8faf-ab4df80dfbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf9d357-4b0d-43f4-984f-7457620231a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d2385e19-0030-4088-9b11-ac2ff8692e32_k7b5vhjs" returned: 1 in 0.636s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d2385e19-0030-4088-9b11-ac2ff8692e32_k7b5vhjs' failed. Not Retrying. {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4b9add-eca5-410a-8ed3-1fadda8e9df9]: (4, 'raw') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d2385e19-0030-4088-9b11-ac2ff8692e32_7qy6o4pzdevstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf9d357-4b0d-43f4-984f-7457620231a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-36220561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d818d7b-030a-4cde-a71c-2551d1aeac03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cd9093ec25c438bbbe266217a70fccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:42Z,use_quota=True,user_id='243a73bc3d0d4c5b9536441b0c8d49f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a870e73-3b40-4ef7-a704-bdf096eb3078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a870e73-3b40-4ef7-a704-bdf096eb3078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3af2f7-70b8-4238-8679-1e8adc4fbf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3af2f7-70b8-4238-8679-1e8adc4fbf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d818d7b-030a-4cde-a71c-2551d1aeac03', 'volume_name': 'volume-6d818d7b-030a-4cde-a71c-2551d1aeac03', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930fe0e8-83d2-44fd-bc28-9d62d157ac01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930fe0e8-83d2-44fd-bc28-9d62d157ac01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d383874-ea03-4bad-a2f6-f22b2ac0239f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:41 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Volume 6d818d7b-030a-4cde-a71c-2551d1aeac03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d818d7b-030a-4cde-a71c-2551d1aeac03', 'volume_size': 1} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:41 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1266e396-0675-4199-aa48-0a65e24f9f51 tempest-CreateVolumesFromImageTest-391852614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-76c9c5d5-33df-4b8f-bdc6-aa5aef09f390" returned: 0 in 0.329s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1266e396-0675-4199-aa48-0a65e24f9f51 tempest-CreateVolumesFromImageTest-391852614 None] Lock "cinder-quobyte-76c9c5d5-33df-4b8f-bdc6-aa5aef09f390" released by "delete_volume" :: held 1.137s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:41 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd542483-e960-45e1-8e8c-29d0b4fe4c20" returned: 0 in 0.477s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.527s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-315371171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309f4ab9-855c-4d67-9dc4-a13c50ee0288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cd9093ec25c438bbbe266217a70fccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:41Z,use_quota=True,user_id='243a73bc3d0d4c5b9536441b0c8d49f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Creating volume 309f4ab9-855c-4d67-9dc4-a13c50ee0288 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:06:41 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-309f4ab9-855c-4d67-9dc4-a13c50ee0288 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:41 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d2385e19-0030-4088-9b11-ac2ff8692e32_7qy6o4pzdevstack@QuobyteHD Sep 04 16:06:41 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:41 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-309f4ab9-855c-4d67-9dc4-a13c50ee0288 1073741824 Sep 04 16:06:41 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394a86d1-5bcb-488e-ab6a-6e9bdb5e4176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd542483-e960-45e1-8e8c-29d0b4fe4c20', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:41 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dee051a-cf68-4fad-a9ac-3d7023c10abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:42 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Volume volume-fd542483-e960-45e1-8e8c-29d0b4fe4c20 (fd542483-e960-45e1-8e8c-29d0b4fe4c20): created successfully Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dee051a-cf68-4fad-a9ac-3d7023c10abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Flow 'volume_create_manager' (ef630f6c-89fb-4de7-ae03-4e27debe02dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-1266e396-0675-4199-aa48-0a65e24f9f51 tempest-CreateVolumesFromImageTest-391852614 None] Created reservations ['c9aceb2f-a0f8-4963-98d0-e2f4c034882b', '1b84cb5b-5da2-480f-b55d-c32cd12e96a4', '84ed52f0-1f88-414f-b0bc-43a5ea23be86', '9a6215b2-0298-47d0-b2a9-bcaaec5c39de'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:06:42 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-a27d563d-e420-42a9-af09-265d662504de tempest-CreateVolumesFromSnapshotTest-1582167689 None] Created volume successfully. Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Flow 'volume_create_manager' (a44317b5-8c0d-4c60-9309-5bb62375c591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (189edd4a-4196-4b86-af76-1956873315ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (189edd4a-4196-4b86-af76-1956873315ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-421231910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd41a1b0-0891-4206-9c87-e0bf97ce8838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cd9093ec25c438bbbe266217a70fccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:42Z,use_quota=True,user_id='243a73bc3d0d4c5b9536441b0c8d49f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (599b403e-1ff7-4a61-ac4c-0c3e091109d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (599b403e-1ff7-4a61-ac4c-0c3e091109d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f6e28be-27aa-4ceb-83d1-3deec33eb94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f6e28be-27aa-4ceb-83d1-3deec33eb94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd41a1b0-0891-4206-9c87-e0bf97ce8838', 'volume_name': 'volume-dd41a1b0-0891-4206-9c87-e0bf97ce8838', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12516d70-f283-40c2-a18a-0485efc012c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12516d70-f283-40c2-a18a-0485efc012c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a33c16c-1102-44fe-99c5-048ffad79025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:42 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Volume dd41a1b0-0891-4206-9c87-e0bf97ce8838: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd41a1b0-0891-4206-9c87-e0bf97ce8838', 'volume_size': 1} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1266e396-0675-4199-aa48-0a65e24f9f51 tempest-CreateVolumesFromImageTest-391852614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1266e396-0675-4199-aa48-0a65e24f9f51 tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1266e396-0675-4199-aa48-0a65e24f9f51 tempest-CreateVolumesFromImageTest-391852614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1266e396-0675-4199-aa48-0a65e24f9f51 tempest-CreateVolumesFromImageTest-391852614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1266e396-0675-4199-aa48-0a65e24f9f51 tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1266e396-0675-4199-aa48-0a65e24f9f51 tempest-CreateVolumesFromImageTest-391852614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:42 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:06:42 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:42 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d2385e19-0030-4088-9b11-ac2ff8692e32_7qy6o4pzdevstack@QuobyteHD" returned: 0 in 0.665s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d2385e19-0030-4088-9b11-ac2ff8692e32_7qy6o4pzdevstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:42 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1266e396-0675-4199-aa48-0a65e24f9f51 tempest-CreateVolumesFromImageTest-391852614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.312s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-1266e396-0675-4199-aa48-0a65e24f9f51 tempest-CreateVolumesFromImageTest-391852614 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:06:42 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-1266e396-0675-4199-aa48-0a65e24f9f51 tempest-CreateVolumesFromImageTest-391852614 None] Deleted volume successfully. Sep 04 16:06:42 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d2385e19-0030-4088-9b11-ac2ff8692e32_7qy6o4pzdevstack@QuobyteHD Sep 04 16:06:42 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1266e396-0675-4199-aa48-0a65e24f9f51 tempest-CreateVolumesFromImageTest-391852614 None] Lock "cinder-76c9c5d5-33df-4b8f-bdc6-aa5aef09f390-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-01d5fef3-53a1-43e2-a2bc-a9b19657e92a tempest-CreateVolumesFromImageTest-391852614 None] Acquiring lock "cinder-5c9a185d-2c6c-4ccd-a3d2-04e6d132942e-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:42 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-309f4ab9-855c-4d67-9dc4-a13c50ee0288 1073741824" returned: 0 in 0.865s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-01d5fef3-53a1-43e2-a2bc-a9b19657e92a tempest-CreateVolumesFromImageTest-391852614 None] Lock "cinder-5c9a185d-2c6c-4ccd-a3d2-04e6d132942e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Flow 'volume_create_manager' (f42042dc-1a3d-45f0-a96b-1c7456b57c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4df540-0320-46de-bf04-bb5c5c9efb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4df540-0320-46de-bf04-bb5c5c9efb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1506822838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ede4a232-6f56-4167-8746-5b1f1265b7c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cd9093ec25c438bbbe266217a70fccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:43Z,use_quota=True,user_id='243a73bc3d0d4c5b9536441b0c8d49f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f156531b-d389-4dac-9097-eb15da0fcb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f156531b-d389-4dac-9097-eb15da0fcb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a88646e-4a1c-4685-bcbb-4f61592be6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a88646e-4a1c-4685-bcbb-4f61592be6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ede4a232-6f56-4167-8746-5b1f1265b7c2', 'volume_name': 'volume-ede4a232-6f56-4167-8746-5b1f1265b7c2', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1723970-2335-4f99-b833-8b27336efe05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1723970-2335-4f99-b833-8b27336efe05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e60cb8-cb84-4db5-9947-c13c406f0b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:42 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Volume ede4a232-6f56-4167-8746-5b1f1265b7c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ede4a232-6f56-4167-8746-5b1f1265b7c2', 'volume_size': 1} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-309f4ab9-855c-4d67-9dc4-a13c50ee0288 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:42 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-01d5fef3-53a1-43e2-a2bc-a9b19657e92a tempest-CreateVolumesFromImageTest-391852614 None] Acquiring lock "cinder-quobyte-5c9a185d-2c6c-4ccd-a3d2-04e6d132942e" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d2385e19-0030-4088-9b11-ac2ff8692e32_7qy6o4pzdevstack@QuobyteHD" returned: 1 in 0.559s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d2385e19-0030-4088-9b11-ac2ff8692e32_7qy6o4pzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] d2385e19-0030-4088-9b11-ac2ff8692e32 was raw, converting to qcow2 {{(pid=87490) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d2385e19-0030-4088-9b11-ac2ff8692e32_7qy6o4pzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ebf3b56b-53b0-4701-b390-580c4620f0eb {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:42 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-309f4ab9-855c-4d67-9dc4-a13c50ee0288 Sep 04 16:06:42 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:42 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-01d5fef3-53a1-43e2-a2bc-a9b19657e92a tempest-CreateVolumesFromImageTest-391852614 None] Lock "cinder-quobyte-5c9a185d-2c6c-4ccd-a3d2-04e6d132942e" acquired by "delete_volume" :: waited 0.036s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:43 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d2385e19-0030-4088-9b11-ac2ff8692e32_7qy6o4pzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ebf3b56b-53b0-4701-b390-580c4620f0eb Sep 04 16:06:43 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c7e1a6-4a15-4334-a3ea-c7c9086f3a6f]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-01d5fef3-53a1-43e2-a2bc-a9b19657e92a tempest-CreateVolumesFromImageTest-391852614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5c9a185d-2c6c-4ccd-a3d2-04e6d132942e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:43 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5c9a185d-2c6c-4ccd-a3d2-04e6d132942e Sep 04 16:06:43 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:43 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-309f4ab9-855c-4d67-9dc4-a13c50ee0288" returned: 0 in 0.297s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.445s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-36220561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d818d7b-030a-4cde-a71c-2551d1aeac03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cd9093ec25c438bbbe266217a70fccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:42Z,use_quota=True,user_id='243a73bc3d0d4c5b9536441b0c8d49f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Creating volume 6d818d7b-030a-4cde-a71c-2551d1aeac03 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:06:43 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6d818d7b-030a-4cde-a71c-2551d1aeac03 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (457161af-11cc-4d33-8fa4-468f4d9182fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-309f4ab9-855c-4d67-9dc4-a13c50ee0288', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea266eaa-d27b-43c6-83e4-6c281c8d7074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:43 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6d818d7b-030a-4cde-a71c-2551d1aeac03 1073741824 Sep 04 16:06:43 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:43 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Volume volume-309f4ab9-855c-4d67-9dc4-a13c50ee0288 (309f4ab9-855c-4d67-9dc4-a13c50ee0288): created successfully Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea266eaa-d27b-43c6-83e4-6c281c8d7074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Flow 'volume_create_manager' (76476a4c-d8ac-4225-b132-6a08fc412e7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:43 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-afbaf45f-d8e5-4108-8209-c0ae09955834 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Created volume successfully. Sep 04 16:06:43 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-01d5fef3-53a1-43e2-a2bc-a9b19657e92a tempest-CreateVolumesFromImageTest-391852614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5c9a185d-2c6c-4ccd-a3d2-04e6d132942e" returned: 0 in 0.429s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-01d5fef3-53a1-43e2-a2bc-a9b19657e92a tempest-CreateVolumesFromImageTest-391852614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5c9a185d-2c6c-4ccd-a3d2-04e6d132942e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:43 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5c9a185d-2c6c-4ccd-a3d2-04e6d132942e Sep 04 16:06:43 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:43 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d2385e19-0030-4088-9b11-ac2ff8692e32_7qy6o4pzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ebf3b56b-53b0-4701-b390-580c4620f0eb" returned: 0 in 0.618s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d2385e19-0030-4088-9b11-ac2ff8692e32_7qy6o4pzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ebf3b56b-53b0-4701-b390-580c4620f0eb {{(pid=87490) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 16:06:43 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Converted 0.00 MB image at 0.00 MB/s Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ebf3b56b-53b0-4701-b390-580c4620f0eb 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:43 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ebf3b56b-53b0-4701-b390-580c4620f0eb 1G Sep 04 16:06:43 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:43 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-01d5fef3-53a1-43e2-a2bc-a9b19657e92a tempest-CreateVolumesFromImageTest-391852614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5c9a185d-2c6c-4ccd-a3d2-04e6d132942e" returned: 0 in 0.318s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-01d5fef3-53a1-43e2-a2bc-a9b19657e92a tempest-CreateVolumesFromImageTest-391852614 None] Lock "cinder-quobyte-5c9a185d-2c6c-4ccd-a3d2-04e6d132942e" released by "delete_volume" :: held 0.804s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-01d5fef3-53a1-43e2-a2bc-a9b19657e92a tempest-CreateVolumesFromImageTest-391852614 None] Created reservations ['96ee37b3-0acc-46e3-aaf2-e7214a4daf7f', 'a142c2c8-5b1c-4e9b-b30b-f85e2b2092fe', 'c45b73b5-695c-4707-9df2-1f9604a709d3', '43ce6d46-3f13-45dd-81f3-e3e213af8001'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:06:43 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6d818d7b-030a-4cde-a71c-2551d1aeac03 1073741824" returned: 0 in 0.668s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-01d5fef3-53a1-43e2-a2bc-a9b19657e92a tempest-CreateVolumesFromImageTest-391852614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-01d5fef3-53a1-43e2-a2bc-a9b19657e92a tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-01d5fef3-53a1-43e2-a2bc-a9b19657e92a tempest-CreateVolumesFromImageTest-391852614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-01d5fef3-53a1-43e2-a2bc-a9b19657e92a tempest-CreateVolumesFromImageTest-391852614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-01d5fef3-53a1-43e2-a2bc-a9b19657e92a tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-01d5fef3-53a1-43e2-a2bc-a9b19657e92a tempest-CreateVolumesFromImageTest-391852614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:43 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:06:43 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6d818d7b-030a-4cde-a71c-2551d1aeac03 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:44 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f0eab5c9-a097-413b-a2e5-bad2c2be8389 tempest-CreateVolumesFromImageTest-391852614 None] Acquiring lock "cinder-2d175ebd-5199-4d31-a0a7-0283dcf42ddc-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ebf3b56b-53b0-4701-b390-580c4620f0eb 1G" returned: 0 in 0.458s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Downloaded image d2385e19-0030-4088-9b11-ac2ff8692e32 ((None, [{'url': 'file:///opt/stack/data/glance/images/d2385e19-0030-4088-9b11-ac2ff8692e32', 'metadata': {}}])) to volume ebf3b56b-53b0-4701-b390-580c4620f0eb successfully. {{(pid=87490) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Temporary image d2385e19-0030-4088-9b11-ac2ff8692e32 for user c17ed5b7fb4d4c7b9677b03d32c55d82 is deleted. {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 16:06:44 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6d818d7b-030a-4cde-a71c-2551d1aeac03 Sep 04 16:06:44 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Marking volume ebf3b56b-53b0-4701-b390-580c4620f0eb as bootable. {{(pid=87490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f0eab5c9-a097-413b-a2e5-bad2c2be8389 tempest-CreateVolumesFromImageTest-391852614 None] Lock "cinder-2d175ebd-5199-4d31-a0a7-0283dcf42ddc-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Copying metadata from image d2385e19-0030-4088-9b11-ac2ff8692e32 to ebf3b56b-53b0-4701-b390-580c4620f0eb. {{(pid=87490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Creating volume glance metadata for volume ebf3b56b-53b0-4701-b390-580c4620f0eb backed by image d2385e19-0030-4088-9b11-ac2ff8692e32 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd2385e19-0030-4088-9b11-ac2ff8692e32', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c82dee119a6f8e5fe4b3d3935c5a66df', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87490) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f0eab5c9-a097-413b-a2e5-bad2c2be8389 tempest-CreateVolumesFromImageTest-391852614 None] Acquiring lock "cinder-quobyte-2d175ebd-5199-4d31-a0a7-0283dcf42ddc" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f0eab5c9-a097-413b-a2e5-bad2c2be8389 tempest-CreateVolumesFromImageTest-391852614 None] Lock "cinder-quobyte-2d175ebd-5199-4d31-a0a7-0283dcf42ddc" acquired by "delete_volume" :: waited 0.042s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa17e1fc-53ac-468f-930b-fb98946b68d5]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f0eab5c9-a097-413b-a2e5-bad2c2be8389 tempest-CreateVolumesFromImageTest-391852614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d175ebd-5199-4d31-a0a7-0283dcf42ddc {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d198e9-f15f-4429-b256-7806559058f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebf3b56b-53b0-4701-b390-580c4620f0eb', 'volume_size': 1, 'image_id': 'd2385e19-0030-4088-9b11-ac2ff8692e32', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d2385e19-0030-4088-9b11-ac2ff8692e32', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c82dee119a6f8e5fe4b3d3935c5a66df', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '03f68433bdbc4c4daa00467b5e0f24fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0a477c7d7d9ea3c22fca596a647a6bd3904e6b311484c809c67cedd70070ec3b84b0efb97603675cde9611ae24c30862efccbda8510b8ca17cb2b71b43d9c7fe', 'id': 'd2385e19-0030-4088-9b11-ac2ff8692e32', 'created_at': datetime.datetime(2026, 9, 4, 14, 6, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 6, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d2385e19-0030-4088-9b11-ac2ff8692e32/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5e53c4-a305-4dc2-a7c9-82b225cb5bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:44 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-01d5fef3-53a1-43e2-a2bc-a9b19657e92a tempest-CreateVolumesFromImageTest-391852614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.411s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-01d5fef3-53a1-43e2-a2bc-a9b19657e92a tempest-CreateVolumesFromImageTest-391852614 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:06:44 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Volume volume-ebf3b56b-53b0-4701-b390-580c4620f0eb (ebf3b56b-53b0-4701-b390-580c4620f0eb): created successfully Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5e53c4-a305-4dc2-a7c9-82b225cb5bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Flow 'volume_create_manager' (98574f4a-3c29-4008-8cc1-b55b3f1b8a2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:44 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-01d5fef3-53a1-43e2-a2bc-a9b19657e92a tempest-CreateVolumesFromImageTest-391852614 None] Deleted volume successfully. Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:06:44 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Flow 'volume_create_manager' (34acfc10-c8e6-4e48-b74e-b46bb5827d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c7305c-6dee-41ca-a6ea-35799df97da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:44 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-306bc170-4944-4010-8265-7d4129d2d52b tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Created volume successfully. Sep 04 16:06:44 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d175ebd-5199-4d31-a0a7-0283dcf42ddc Sep 04 16:06:44 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6d818d7b-030a-4cde-a71c-2551d1aeac03" returned: 0 in 0.428s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.194s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-421231910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd41a1b0-0891-4206-9c87-e0bf97ce8838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cd9093ec25c438bbbe266217a70fccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:42Z,use_quota=True,user_id='243a73bc3d0d4c5b9536441b0c8d49f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Creating volume dd41a1b0-0891-4206-9c87-e0bf97ce8838 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:06:44 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-dd41a1b0-0891-4206-9c87-e0bf97ce8838 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-01d5fef3-53a1-43e2-a2bc-a9b19657e92a tempest-CreateVolumesFromImageTest-391852614 None] Lock "cinder-5c9a185d-2c6c-4ccd-a3d2-04e6d132942e-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:44 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-dd41a1b0-0891-4206-9c87-e0bf97ce8838 1073741824 Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c7305c-6dee-41ca-a6ea-35799df97da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1325436517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=249ea0c1-bd5f-4269-a504-9cbe0a49944a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7466c6c5dd5848b4b1ec5ac0b530e5f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:44Z,use_quota=True,user_id='a5a7a3f853b143388eb82fa5d50d7792',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:44 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746cac56-c18b-475c-a596-64a6deaa9348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746cac56-c18b-475c-a596-64a6deaa9348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96bffd1c-79b5-4717-affe-6d453cc9faf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96bffd1c-79b5-4717-affe-6d453cc9faf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '249ea0c1-bd5f-4269-a504-9cbe0a49944a', 'volume_name': 'volume-249ea0c1-bd5f-4269-a504-9cbe0a49944a', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58e5989-6a9c-498d-a9fe-3774c8368e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58e5989-6a9c-498d-a9fe-3774c8368e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0563c62a-2c6f-477b-b8fa-adeb841cf84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:44 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Volume 249ea0c1-bd5f-4269-a504-9cbe0a49944a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-249ea0c1-bd5f-4269-a504-9cbe0a49944a', 'volume_size': 1} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d383874-ea03-4bad-a2f6-f22b2ac0239f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d818d7b-030a-4cde-a71c-2551d1aeac03', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d1cbb37-6a5b-4813-bc34-cd51b1f57594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:44 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Volume volume-6d818d7b-030a-4cde-a71c-2551d1aeac03 (6d818d7b-030a-4cde-a71c-2551d1aeac03): created successfully Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d1cbb37-6a5b-4813-bc34-cd51b1f57594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Flow 'volume_create_manager' (1bf860dd-7357-4ae0-8faf-ab4df80dfbe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:44 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-fcf67c91-4f8b-4632-9cb2-bbb0d03778d5 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Created volume successfully. Sep 04 16:06:44 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f0eab5c9-a097-413b-a2e5-bad2c2be8389 tempest-CreateVolumesFromImageTest-391852614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d175ebd-5199-4d31-a0a7-0283dcf42ddc" returned: 0 in 0.527s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f0eab5c9-a097-413b-a2e5-bad2c2be8389 tempest-CreateVolumesFromImageTest-391852614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d175ebd-5199-4d31-a0a7-0283dcf42ddc {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a68986f4-0761-4554-be8c-831eeacf9b6e tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Acquiring lock "cinder-ebf3b56b-53b0-4701-b390-580c4620f0eb-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:44 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d175ebd-5199-4d31-a0a7-0283dcf42ddc Sep 04 16:06:44 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a68986f4-0761-4554-be8c-831eeacf9b6e tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Lock "cinder-ebf3b56b-53b0-4701-b390-580c4620f0eb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a68986f4-0761-4554-be8c-831eeacf9b6e tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Acquiring lock "cinder-quobyte-ebf3b56b-53b0-4701-b390-580c4620f0eb" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a68986f4-0761-4554-be8c-831eeacf9b6e tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Lock "cinder-quobyte-ebf3b56b-53b0-4701-b390-580c4620f0eb" acquired by "delete_volume" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5831d4f-5f0c-4a73-8d7c-b3d0e8446769]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a68986f4-0761-4554-be8c-831eeacf9b6e tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ebf3b56b-53b0-4701-b390-580c4620f0eb {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:45 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ebf3b56b-53b0-4701-b390-580c4620f0eb Sep 04 16:06:45 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:45 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-dd41a1b0-0891-4206-9c87-e0bf97ce8838 1073741824" returned: 0 in 0.636s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-dd41a1b0-0891-4206-9c87-e0bf97ce8838 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:45 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f0eab5c9-a097-413b-a2e5-bad2c2be8389 tempest-CreateVolumesFromImageTest-391852614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-2d175ebd-5199-4d31-a0a7-0283dcf42ddc" returned: 0 in 0.367s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:45 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-dd41a1b0-0891-4206-9c87-e0bf97ce8838 Sep 04 16:06:45 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f0eab5c9-a097-413b-a2e5-bad2c2be8389 tempest-CreateVolumesFromImageTest-391852614 None] Lock "cinder-quobyte-2d175ebd-5199-4d31-a0a7-0283dcf42ddc" released by "delete_volume" :: held 0.966s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-f0eab5c9-a097-413b-a2e5-bad2c2be8389 tempest-CreateVolumesFromImageTest-391852614 None] Created reservations ['cab7e44a-0557-4530-9be4-06e07f04b425', '00101d71-e3f2-476d-bfec-6e2f9c6256bb', '918cf047-1ffc-4a82-9ced-52555b32a49b', '1c54a383-7f61-49d9-b42f-c32feae37fd5'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f0eab5c9-a097-413b-a2e5-bad2c2be8389 tempest-CreateVolumesFromImageTest-391852614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f0eab5c9-a097-413b-a2e5-bad2c2be8389 tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f0eab5c9-a097-413b-a2e5-bad2c2be8389 tempest-CreateVolumesFromImageTest-391852614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-f0eab5c9-a097-413b-a2e5-bad2c2be8389 tempest-CreateVolumesFromImageTest-391852614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-f0eab5c9-a097-413b-a2e5-bad2c2be8389 tempest-CreateVolumesFromImageTest-391852614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f0eab5c9-a097-413b-a2e5-bad2c2be8389 tempest-CreateVolumesFromImageTest-391852614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:45 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a68986f4-0761-4554-be8c-831eeacf9b6e tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ebf3b56b-53b0-4701-b390-580c4620f0eb" returned: 0 in 0.490s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a68986f4-0761-4554-be8c-831eeacf9b6e tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ebf3b56b-53b0-4701-b390-580c4620f0eb {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:45 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:06:45 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:45 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ebf3b56b-53b0-4701-b390-580c4620f0eb Sep 04 16:06:45 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:45 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-dd41a1b0-0891-4206-9c87-e0bf97ce8838" returned: 0 in 0.398s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.636s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1506822838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ede4a232-6f56-4167-8746-5b1f1265b7c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cd9093ec25c438bbbe266217a70fccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:43Z,use_quota=True,user_id='243a73bc3d0d4c5b9536441b0c8d49f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Creating volume ede4a232-6f56-4167-8746-5b1f1265b7c2 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:06:45 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ede4a232-6f56-4167-8746-5b1f1265b7c2 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:45 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ede4a232-6f56-4167-8746-5b1f1265b7c2 1073741824 Sep 04 16:06:45 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a33c16c-1102-44fe-99c5-048ffad79025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd41a1b0-0891-4206-9c87-e0bf97ce8838', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb3e056-e562-49d2-a860-8be2c4c35dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:45 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Volume volume-dd41a1b0-0891-4206-9c87-e0bf97ce8838 (dd41a1b0-0891-4206-9c87-e0bf97ce8838): created successfully Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb3e056-e562-49d2-a860-8be2c4c35dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Flow 'volume_create_manager' (a44317b5-8c0d-4c60-9309-5bb62375c591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:45 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-274b645d-3369-4796-b8ec-6923f91e3d9d tempest-CreateVolumesFromSnapshotTest-1582167689 None] Created volume successfully. Sep 04 16:06:45 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f0eab5c9-a097-413b-a2e5-bad2c2be8389 tempest-CreateVolumesFromImageTest-391852614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.262s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-f0eab5c9-a097-413b-a2e5-bad2c2be8389 tempest-CreateVolumesFromImageTest-391852614 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:06:45 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-f0eab5c9-a097-413b-a2e5-bad2c2be8389 tempest-CreateVolumesFromImageTest-391852614 None] Deleted volume successfully. Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f0eab5c9-a097-413b-a2e5-bad2c2be8389 tempest-CreateVolumesFromImageTest-391852614 None] Lock "cinder-2d175ebd-5199-4d31-a0a7-0283dcf42ddc-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:45 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a68986f4-0761-4554-be8c-831eeacf9b6e tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ebf3b56b-53b0-4701-b390-580c4620f0eb" returned: 0 in 0.326s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a68986f4-0761-4554-be8c-831eeacf9b6e tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Lock "cinder-quobyte-ebf3b56b-53b0-4701-b390-580c4620f0eb" released by "delete_volume" :: held 0.873s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-a68986f4-0761-4554-be8c-831eeacf9b6e tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Created reservations ['e47762f4-b54b-4df4-bde6-8fa61c41dafd', '220a7b39-7f8a-4f22-abb4-e84eb17ff112', 'e4f2c0e9-0334-4a00-8368-8ebaab866c75', '223e40f8-f06f-48b8-bec4-c93222f5606f'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a68986f4-0761-4554-be8c-831eeacf9b6e tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a68986f4-0761-4554-be8c-831eeacf9b6e tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a68986f4-0761-4554-be8c-831eeacf9b6e tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a68986f4-0761-4554-be8c-831eeacf9b6e tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a68986f4-0761-4554-be8c-831eeacf9b6e tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a68986f4-0761-4554-be8c-831eeacf9b6e tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:45 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:06:45 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:46 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ede4a232-6f56-4167-8746-5b1f1265b7c2 1073741824" returned: 0 in 0.544s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ede4a232-6f56-4167-8746-5b1f1265b7c2 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:46 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ede4a232-6f56-4167-8746-5b1f1265b7c2 Sep 04 16:06:46 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:46 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a68986f4-0761-4554-be8c-831eeacf9b6e tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.331s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:46 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-a68986f4-0761-4554-be8c-831eeacf9b6e tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:06:46 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-a68986f4-0761-4554-be8c-831eeacf9b6e tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Deleted volume successfully. Sep 04 16:06:46 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a68986f4-0761-4554-be8c-831eeacf9b6e tempest-VolumeAndVolumeTypeFromImageTest-792140489 None] Lock "cinder-ebf3b56b-53b0-4701-b390-580c4620f0eb-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:46 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ede4a232-6f56-4167-8746-5b1f1265b7c2" returned: 0 in 0.294s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:46 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:06:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.952s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:46 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1325436517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=249ea0c1-bd5f-4269-a504-9cbe0a49944a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7466c6c5dd5848b4b1ec5ac0b530e5f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:44Z,use_quota=True,user_id='a5a7a3f853b143388eb82fa5d50d7792',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:06:46 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Creating volume 249ea0c1-bd5f-4269-a504-9cbe0a49944a {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:06:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:46 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:46 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:46 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:06:46 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:06:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-249ea0c1-bd5f-4269-a504-9cbe0a49944a 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e60cb8-cb84-4db5-9947-c13c406f0b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ede4a232-6f56-4167-8746-5b1f1265b7c2', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:46 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-249ea0c1-bd5f-4269-a504-9cbe0a49944a 1073741824 Sep 04 16:06:46 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea73e4f-d5e8-4259-a579-61d8a738b65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:46 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Volume volume-ede4a232-6f56-4167-8746-5b1f1265b7c2 (ede4a232-6f56-4167-8746-5b1f1265b7c2): created successfully Sep 04 16:06:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea73e4f-d5e8-4259-a579-61d8a738b65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:46 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Flow 'volume_create_manager' (f42042dc-1a3d-45f0-a96b-1c7456b57c1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:46 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-1f308d7a-d3f8-4841-8dae-540adfefe6a9 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Created volume successfully. Sep 04 16:06:47 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-249ea0c1-bd5f-4269-a504-9cbe0a49944a 1073741824" returned: 0 in 0.572s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-249ea0c1-bd5f-4269-a504-9cbe0a49944a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:47 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-249ea0c1-bd5f-4269-a504-9cbe0a49944a Sep 04 16:06:47 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2352fd41-2173-4693-88a0-34bdc57d4c1b tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "cinder-ede4a232-6f56-4167-8746-5b1f1265b7c2-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2352fd41-2173-4693-88a0-34bdc57d4c1b tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-ede4a232-6f56-4167-8746-5b1f1265b7c2-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2352fd41-2173-4693-88a0-34bdc57d4c1b tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "cinder-quobyte-ede4a232-6f56-4167-8746-5b1f1265b7c2" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2352fd41-2173-4693-88a0-34bdc57d4c1b tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-quobyte-ede4a232-6f56-4167-8746-5b1f1265b7c2" acquired by "delete_volume" :: waited 0.033s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:47 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-249ea0c1-bd5f-4269-a504-9cbe0a49944a" returned: 0 in 0.460s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:47 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:06:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:47 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e13968-1a69-4c86-b035-e7ca5d993f01]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2352fd41-2173-4693-88a0-34bdc57d4c1b tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ede4a232-6f56-4167-8746-5b1f1265b7c2 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0563c62a-2c6f-477b-b8fa-adeb841cf84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-249ea0c1-bd5f-4269-a504-9cbe0a49944a', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eec0db9-3c19-486e-9ac8-0f73c4a76ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:47 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Volume volume-249ea0c1-bd5f-4269-a504-9cbe0a49944a (249ea0c1-bd5f-4269-a504-9cbe0a49944a): created successfully Sep 04 16:06:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eec0db9-3c19-486e-9ac8-0f73c4a76ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:47 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Flow 'volume_create_manager' (34acfc10-c8e6-4e48-b74e-b46bb5827d4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:47 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-a6aace69-26a8-493e-a149-3e0c4347efc5 tempest-ProjectReaderTests-81314965 None] Created volume successfully. Sep 04 16:06:47 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ede4a232-6f56-4167-8746-5b1f1265b7c2 Sep 04 16:06:47 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:48 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2352fd41-2173-4693-88a0-34bdc57d4c1b tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ede4a232-6f56-4167-8746-5b1f1265b7c2" returned: 0 in 0.442s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2352fd41-2173-4693-88a0-34bdc57d4c1b tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ede4a232-6f56-4167-8746-5b1f1265b7c2 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:48 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ede4a232-6f56-4167-8746-5b1f1265b7c2 Sep 04 16:06:48 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:48 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2352fd41-2173-4693-88a0-34bdc57d4c1b tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ede4a232-6f56-4167-8746-5b1f1265b7c2" returned: 0 in 0.354s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:48 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2352fd41-2173-4693-88a0-34bdc57d4c1b tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-quobyte-ede4a232-6f56-4167-8746-5b1f1265b7c2" released by "delete_volume" :: held 0.862s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:48 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-2352fd41-2173-4693-88a0-34bdc57d4c1b tempest-CreateVolumesFromSnapshotTest-1582167689 None] Created reservations ['453a0d22-098f-4157-93eb-06c71579b6d6', 'caacc547-791e-440f-be05-c88500dbd9eb', 'd0e6ecd4-9438-43f4-9128-5136a0de7727', '558f44bf-efc5-4b51-8e08-d41793c2b253'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:06:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2352fd41-2173-4693-88a0-34bdc57d4c1b tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2352fd41-2173-4693-88a0-34bdc57d4c1b tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2352fd41-2173-4693-88a0-34bdc57d4c1b tempest-CreateVolumesFromSnapshotTest-1582167689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:48 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2352fd41-2173-4693-88a0-34bdc57d4c1b tempest-CreateVolumesFromSnapshotTest-1582167689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2352fd41-2173-4693-88a0-34bdc57d4c1b tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2352fd41-2173-4693-88a0-34bdc57d4c1b tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:48 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:06:48 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:48 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-71ccba50-28f4-411f-9fa7-b8d8bf958087 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "cinder-dd41a1b0-0891-4206-9c87-e0bf97ce8838-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:48 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-71ccba50-28f4-411f-9fa7-b8d8bf958087 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-dd41a1b0-0891-4206-9c87-e0bf97ce8838-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:48 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-71ccba50-28f4-411f-9fa7-b8d8bf958087 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "cinder-quobyte-dd41a1b0-0891-4206-9c87-e0bf97ce8838" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:48 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-71ccba50-28f4-411f-9fa7-b8d8bf958087 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-quobyte-dd41a1b0-0891-4206-9c87-e0bf97ce8838" acquired by "delete_volume" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:48 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c77d50-f4f4-48c5-bb2a-cc6c6a375407]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-71ccba50-28f4-411f-9fa7-b8d8bf958087 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-dd41a1b0-0891-4206-9c87-e0bf97ce8838 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:48 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-dd41a1b0-0891-4206-9c87-e0bf97ce8838 Sep 04 16:06:48 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:49 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2352fd41-2173-4693-88a0-34bdc57d4c1b tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.556s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:49 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-2352fd41-2173-4693-88a0-34bdc57d4c1b tempest-CreateVolumesFromSnapshotTest-1582167689 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:06:49 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-2352fd41-2173-4693-88a0-34bdc57d4c1b tempest-CreateVolumesFromSnapshotTest-1582167689 None] Deleted volume successfully. Sep 04 16:06:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c115c219-2dea-4c7d-bcc9-1c89c01c63d8 tempest-ProjectReaderTests-81314965 None] Acquiring lock "cinder-249ea0c1-bd5f-4269-a504-9cbe0a49944a-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c115c219-2dea-4c7d-bcc9-1c89c01c63d8 tempest-ProjectReaderTests-81314965 None] Lock "cinder-249ea0c1-bd5f-4269-a504-9cbe0a49944a-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2352fd41-2173-4693-88a0-34bdc57d4c1b tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-ede4a232-6f56-4167-8746-5b1f1265b7c2-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c115c219-2dea-4c7d-bcc9-1c89c01c63d8 tempest-ProjectReaderTests-81314965 None] Acquiring lock "cinder-quobyte-249ea0c1-bd5f-4269-a504-9cbe0a49944a" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c115c219-2dea-4c7d-bcc9-1c89c01c63d8 tempest-ProjectReaderTests-81314965 None] Lock "cinder-quobyte-249ea0c1-bd5f-4269-a504-9cbe0a49944a" acquired by "delete_volume" :: waited 0.019s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:49 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c2a7cc-44d4-4b6b-ba8b-26c63819da0b]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c115c219-2dea-4c7d-bcc9-1c89c01c63d8 tempest-ProjectReaderTests-81314965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-249ea0c1-bd5f-4269-a504-9cbe0a49944a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:49 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-71ccba50-28f4-411f-9fa7-b8d8bf958087 tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-dd41a1b0-0891-4206-9c87-e0bf97ce8838" returned: 0 in 0.618s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-71ccba50-28f4-411f-9fa7-b8d8bf958087 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-dd41a1b0-0891-4206-9c87-e0bf97ce8838 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:49 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-dd41a1b0-0891-4206-9c87-e0bf97ce8838 Sep 04 16:06:49 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:49 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-249ea0c1-bd5f-4269-a504-9cbe0a49944a Sep 04 16:06:49 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:49 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-71ccba50-28f4-411f-9fa7-b8d8bf958087 tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-dd41a1b0-0891-4206-9c87-e0bf97ce8838" returned: 0 in 0.382s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-71ccba50-28f4-411f-9fa7-b8d8bf958087 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-quobyte-dd41a1b0-0891-4206-9c87-e0bf97ce8838" released by "delete_volume" :: held 1.081s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:49 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c115c219-2dea-4c7d-bcc9-1c89c01c63d8 tempest-ProjectReaderTests-81314965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-249ea0c1-bd5f-4269-a504-9cbe0a49944a" returned: 0 in 0.544s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c115c219-2dea-4c7d-bcc9-1c89c01c63d8 tempest-ProjectReaderTests-81314965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-249ea0c1-bd5f-4269-a504-9cbe0a49944a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:49 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-71ccba50-28f4-411f-9fa7-b8d8bf958087 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Created reservations ['a07c5902-d0b2-4f88-bfc2-ebd09c121eea', 'f49fe381-7c3c-445b-b9f1-376dcd1f9a5e', '7a830457-08da-4ada-bece-5e6b99b947a5', '36efb961-7af3-4ae3-95b0-bdea19293da0'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:06:49 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-249ea0c1-bd5f-4269-a504-9cbe0a49944a Sep 04 16:06:49 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-71ccba50-28f4-411f-9fa7-b8d8bf958087 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-71ccba50-28f4-411f-9fa7-b8d8bf958087 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-71ccba50-28f4-411f-9fa7-b8d8bf958087 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-71ccba50-28f4-411f-9fa7-b8d8bf958087 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-71ccba50-28f4-411f-9fa7-b8d8bf958087 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-71ccba50-28f4-411f-9fa7-b8d8bf958087 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:50 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:06:50 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:50 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c115c219-2dea-4c7d-bcc9-1c89c01c63d8 tempest-ProjectReaderTests-81314965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-249ea0c1-bd5f-4269-a504-9cbe0a49944a" returned: 0 in 0.380s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c115c219-2dea-4c7d-bcc9-1c89c01c63d8 tempest-ProjectReaderTests-81314965 None] Lock "cinder-quobyte-249ea0c1-bd5f-4269-a504-9cbe0a49944a" released by "delete_volume" :: held 0.993s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Flow 'volume_create_manager' (d32b59d2-f1e1-4680-803d-40360876b77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a387c1-82ee-4de6-bb89-0509356be1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a387c1-82ee-4de6-bb89-0509356be1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1668250936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adcff4af-6681-4a3c-91de-ffe290f5dbaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ca6d87e28a469d904de52115a42255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:50Z,use_quota=True,user_id='2cf8224d97d44262bb3f5a0424ad1910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:50 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9337d6dd-e289-4b1a-ac7d-bc446f956242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9337d6dd-e289-4b1a-ac7d-bc446f956242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3494420-c050-46c3-b1e4-5a33c2159cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3494420-c050-46c3-b1e4-5a33c2159cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adcff4af-6681-4a3c-91de-ffe290f5dbaf', 'volume_name': 'volume-adcff4af-6681-4a3c-91de-ffe290f5dbaf', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb0d288-e480-456d-b903-c16161f64798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb0d288-e480-456d-b903-c16161f64798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6748682-5224-4fca-9c9c-3efdb66fc431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:50 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Volume adcff4af-6681-4a3c-91de-ffe290f5dbaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adcff4af-6681-4a3c-91de-ffe290f5dbaf', 'volume_size': 1} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1668250936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adcff4af-6681-4a3c-91de-ffe290f5dbaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ca6d87e28a469d904de52115a42255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:50Z,use_quota=True,user_id='2cf8224d97d44262bb3f5a0424ad1910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Creating volume adcff4af-6681-4a3c-91de-ffe290f5dbaf {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:06:50 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-adcff4af-6681-4a3c-91de-ffe290f5dbaf 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-71ccba50-28f4-411f-9fa7-b8d8bf958087 tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.393s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-71ccba50-28f4-411f-9fa7-b8d8bf958087 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:06:50 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-adcff4af-6681-4a3c-91de-ffe290f5dbaf 1073741824 Sep 04 16:06:50 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:50 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-71ccba50-28f4-411f-9fa7-b8d8bf958087 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Deleted volume successfully. Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-c115c219-2dea-4c7d-bcc9-1c89c01c63d8 tempest-ProjectReaderTests-81314965 None] Created reservations ['293f851f-50dc-4e0a-98ee-d81b7ae0f13b', '79be1a6b-619f-47af-9bda-bb57cfb300b4', 'e5b7e740-7bf9-458f-98bf-473ff61d8f20', '5fcbfab9-8fc0-4654-9074-c89d8ac0aca6'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-71ccba50-28f4-411f-9fa7-b8d8bf958087 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-dd41a1b0-0891-4206-9c87-e0bf97ce8838-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c115c219-2dea-4c7d-bcc9-1c89c01c63d8 tempest-ProjectReaderTests-81314965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c115c219-2dea-4c7d-bcc9-1c89c01c63d8 tempest-ProjectReaderTests-81314965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c115c219-2dea-4c7d-bcc9-1c89c01c63d8 tempest-ProjectReaderTests-81314965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c115c219-2dea-4c7d-bcc9-1c89c01c63d8 tempest-ProjectReaderTests-81314965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c115c219-2dea-4c7d-bcc9-1c89c01c63d8 tempest-ProjectReaderTests-81314965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c115c219-2dea-4c7d-bcc9-1c89c01c63d8 tempest-ProjectReaderTests-81314965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:50 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:06:50 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:50 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-98d9ff0e-195c-4c14-8cd3-1b66f710a299 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "cinder-6d818d7b-030a-4cde-a71c-2551d1aeac03-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:51 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c115c219-2dea-4c7d-bcc9-1c89c01c63d8 tempest-ProjectReaderTests-81314965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.307s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:51 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-c115c219-2dea-4c7d-bcc9-1c89c01c63d8 tempest-ProjectReaderTests-81314965 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:06:51 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-98d9ff0e-195c-4c14-8cd3-1b66f710a299 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-6d818d7b-030a-4cde-a71c-2551d1aeac03-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:51 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-c115c219-2dea-4c7d-bcc9-1c89c01c63d8 tempest-ProjectReaderTests-81314965 None] Deleted volume successfully. Sep 04 16:06:51 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c115c219-2dea-4c7d-bcc9-1c89c01c63d8 tempest-ProjectReaderTests-81314965 None] Lock "cinder-249ea0c1-bd5f-4269-a504-9cbe0a49944a-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:51 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-98d9ff0e-195c-4c14-8cd3-1b66f710a299 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "cinder-quobyte-6d818d7b-030a-4cde-a71c-2551d1aeac03" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:51 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-98d9ff0e-195c-4c14-8cd3-1b66f710a299 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-quobyte-6d818d7b-030a-4cde-a71c-2551d1aeac03" acquired by "delete_volume" :: waited 0.019s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:51 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6a89fe-b682-4ba4-ba18-014c40a40945]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:51 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-98d9ff0e-195c-4c14-8cd3-1b66f710a299 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6d818d7b-030a-4cde-a71c-2551d1aeac03 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-adcff4af-6681-4a3c-91de-ffe290f5dbaf 1073741824" returned: 0 in 0.621s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-adcff4af-6681-4a3c-91de-ffe290f5dbaf {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:51 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-adcff4af-6681-4a3c-91de-ffe290f5dbaf Sep 04 16:06:51 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:51 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6d818d7b-030a-4cde-a71c-2551d1aeac03 Sep 04 16:06:51 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:51 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-adcff4af-6681-4a3c-91de-ffe290f5dbaf" returned: 0 in 0.250s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:51 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:06:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6748682-5224-4fca-9c9c-3efdb66fc431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adcff4af-6681-4a3c-91de-ffe290f5dbaf', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a5cc78-5c09-4764-944c-e0c5872dd32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:51 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Volume volume-adcff4af-6681-4a3c-91de-ffe290f5dbaf (adcff4af-6681-4a3c-91de-ffe290f5dbaf): created successfully Sep 04 16:06:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a5cc78-5c09-4764-944c-e0c5872dd32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:51 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Flow 'volume_create_manager' (d32b59d2-f1e1-4680-803d-40360876b77c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:51 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-6d463510-3270-4f8c-a32f-ac6441df2c99 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Created volume successfully. Sep 04 16:06:51 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-98d9ff0e-195c-4c14-8cd3-1b66f710a299 tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6d818d7b-030a-4cde-a71c-2551d1aeac03" returned: 0 in 0.438s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-98d9ff0e-195c-4c14-8cd3-1b66f710a299 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6d818d7b-030a-4cde-a71c-2551d1aeac03 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:51 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6d818d7b-030a-4cde-a71c-2551d1aeac03 Sep 04 16:06:51 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:51 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-98d9ff0e-195c-4c14-8cd3-1b66f710a299 tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6d818d7b-030a-4cde-a71c-2551d1aeac03" returned: 0 in 0.288s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:51 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-98d9ff0e-195c-4c14-8cd3-1b66f710a299 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-quobyte-6d818d7b-030a-4cde-a71c-2551d1aeac03" released by "delete_volume" :: held 0.787s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:51 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-98d9ff0e-195c-4c14-8cd3-1b66f710a299 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Created reservations ['67bb1e21-d943-42ca-883e-520a8ad84368', '31dd6332-8f47-444b-a42c-72cbc2888704', 'ee2141d3-ccba-4ef6-9dc0-8174b1ed1760', '764abc05-eddf-4274-800f-4400d786a7bd'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Flow 'volume_create_manager' (5a1183fc-d4c4-4224-9791-421f46a7e94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddbaa95a-9c79-4954-ad50-7e8f07290c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-98d9ff0e-195c-4c14-8cd3-1b66f710a299 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-98d9ff0e-195c-4c14-8cd3-1b66f710a299 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-98d9ff0e-195c-4c14-8cd3-1b66f710a299 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-98d9ff0e-195c-4c14-8cd3-1b66f710a299 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-98d9ff0e-195c-4c14-8cd3-1b66f710a299 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-98d9ff0e-195c-4c14-8cd3-1b66f710a299 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddbaa95a-9c79-4954-ad50-7e8f07290c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-930889291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34812ad-180f-4fc3-87c5-9a645c7f7fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7466c6c5dd5848b4b1ec5ac0b530e5f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:52Z,use_quota=True,user_id='a5a7a3f853b143388eb82fa5d50d7792',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:52 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d74158e4-7259-40b8-806b-6e80ec3d0cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:52 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d74158e4-7259-40b8-806b-6e80ec3d0cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a49727-5b0a-4038-afcd-89a3cdf714c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a49727-5b0a-4038-afcd-89a3cdf714c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b34812ad-180f-4fc3-87c5-9a645c7f7fb8', 'volume_name': 'volume-b34812ad-180f-4fc3-87c5-9a645c7f7fb8', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d3741e6-9892-4910-a4ba-557c2442039a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d3741e6-9892-4910-a4ba-557c2442039a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8cd8dfc-efad-4268-9ace-28abe526ff8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:52 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Volume b34812ad-180f-4fc3-87c5-9a645c7f7fb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b34812ad-180f-4fc3-87c5-9a645c7f7fb8', 'volume_size': 1} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-930889291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34812ad-180f-4fc3-87c5-9a645c7f7fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7466c6c5dd5848b4b1ec5ac0b530e5f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:52Z,use_quota=True,user_id='a5a7a3f853b143388eb82fa5d50d7792',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Creating volume b34812ad-180f-4fc3-87c5-9a645c7f7fb8 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:06:52 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b34812ad-180f-4fc3-87c5-9a645c7f7fb8 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-096b9644-d35a-4366-bdd7-114899617276 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "cinder-309f4ab9-855c-4d67-9dc4-a13c50ee0288-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:52 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b34812ad-180f-4fc3-87c5-9a645c7f7fb8 1073741824 Sep 04 16:06:52 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-096b9644-d35a-4366-bdd7-114899617276 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-309f4ab9-855c-4d67-9dc4-a13c50ee0288-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-096b9644-d35a-4366-bdd7-114899617276 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "cinder-quobyte-309f4ab9-855c-4d67-9dc4-a13c50ee0288" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-096b9644-d35a-4366-bdd7-114899617276 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-quobyte-309f4ab9-855c-4d67-9dc4-a13c50ee0288" acquired by "delete_volume" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[274afd37-5741-4718-87d5-544fe4700c84]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-096b9644-d35a-4366-bdd7-114899617276 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-309f4ab9-855c-4d67-9dc4-a13c50ee0288 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:52 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-309f4ab9-855c-4d67-9dc4-a13c50ee0288 Sep 04 16:06:52 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:52 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-98d9ff0e-195c-4c14-8cd3-1b66f710a299 tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.459s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-98d9ff0e-195c-4c14-8cd3-1b66f710a299 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:06:52 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-98d9ff0e-195c-4c14-8cd3-1b66f710a299 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Deleted volume successfully. Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-98d9ff0e-195c-4c14-8cd3-1b66f710a299 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-6d818d7b-030a-4cde-a71c-2551d1aeac03-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:52 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b34812ad-180f-4fc3-87c5-9a645c7f7fb8 1073741824" returned: 0 in 0.597s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b34812ad-180f-4fc3-87c5-9a645c7f7fb8 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:52 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-096b9644-d35a-4366-bdd7-114899617276 tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-309f4ab9-855c-4d67-9dc4-a13c50ee0288" returned: 0 in 0.467s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-096b9644-d35a-4366-bdd7-114899617276 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-309f4ab9-855c-4d67-9dc4-a13c50ee0288 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:52 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b34812ad-180f-4fc3-87c5-9a645c7f7fb8 Sep 04 16:06:52 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:52 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-309f4ab9-855c-4d67-9dc4-a13c50ee0288 Sep 04 16:06:52 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:53 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-096b9644-d35a-4366-bdd7-114899617276 tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-309f4ab9-855c-4d67-9dc4-a13c50ee0288" returned: 0 in 0.329s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-096b9644-d35a-4366-bdd7-114899617276 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-quobyte-309f4ab9-855c-4d67-9dc4-a13c50ee0288" released by "delete_volume" :: held 0.857s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:53 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b34812ad-180f-4fc3-87c5-9a645c7f7fb8" returned: 0 in 0.378s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8cd8dfc-efad-4268-9ace-28abe526ff8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b34812ad-180f-4fc3-87c5-9a645c7f7fb8', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae2e0d3-1599-459a-bd2d-1d3c085d5e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:53 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Volume volume-b34812ad-180f-4fc3-87c5-9a645c7f7fb8 (b34812ad-180f-4fc3-87c5-9a645c7f7fb8): created successfully Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae2e0d3-1599-459a-bd2d-1d3c085d5e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Flow 'volume_create_manager' (5a1183fc-d4c4-4224-9791-421f46a7e94a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Flow 'volume_create_manager' (a4999b74-fa84-4833-9a41-3d2cd7885e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (219c4118-6470-41d9-ba45-6111ac8d1ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:53 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-60d6a9b6-16ef-42b6-89cf-e304df6f1fbe tempest-ProjectReaderTests-81314965 None] Created volume successfully. Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (219c4118-6470-41d9-ba45-6111ac8d1ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1219505803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d750107e-fa5a-4b19-a774-65831a3c7dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ca6d87e28a469d904de52115a42255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:53Z,use_quota=True,user_id='2cf8224d97d44262bb3f5a0424ad1910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a680ce5e-39c3-4f42-8d5c-3919c32488c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a680ce5e-39c3-4f42-8d5c-3919c32488c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (129beb54-ac86-4366-a8fa-81d0d803ed35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (129beb54-ac86-4366-a8fa-81d0d803ed35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd750107e-fa5a-4b19-a774-65831a3c7dcc', 'volume_name': 'volume-d750107e-fa5a-4b19-a774-65831a3c7dcc', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46726430-ad79-4ca8-af72-685afac95f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46726430-ad79-4ca8-af72-685afac95f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa1fccc-fa74-4ecd-bd6d-fc2f96502d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:53 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Volume d750107e-fa5a-4b19-a774-65831a3c7dcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d750107e-fa5a-4b19-a774-65831a3c7dcc', 'volume_size': 1} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1219505803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d750107e-fa5a-4b19-a774-65831a3c7dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ca6d87e28a469d904de52115a42255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:53Z,use_quota=True,user_id='2cf8224d97d44262bb3f5a0424ad1910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Creating volume d750107e-fa5a-4b19-a774-65831a3c7dcc {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:06:53 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d750107e-fa5a-4b19-a774-65831a3c7dcc 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:53 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d750107e-fa5a-4b19-a774-65831a3c7dcc 1073741824 Sep 04 16:06:53 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-096b9644-d35a-4366-bdd7-114899617276 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Created reservations ['5b796887-1c5b-4662-a0f2-013884b72c67', '5cf52bad-4852-4017-a50c-872442c1c923', 'd22dd473-c235-43c4-8fe9-c2a2140a8ab5', 'be5d1719-6e81-4db9-b964-4f2c44674de1'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-096b9644-d35a-4366-bdd7-114899617276 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-096b9644-d35a-4366-bdd7-114899617276 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-096b9644-d35a-4366-bdd7-114899617276 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-096b9644-d35a-4366-bdd7-114899617276 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-096b9644-d35a-4366-bdd7-114899617276 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-096b9644-d35a-4366-bdd7-114899617276 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:53 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:06:53 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:53 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-096b9644-d35a-4366-bdd7-114899617276 tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.316s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-096b9644-d35a-4366-bdd7-114899617276 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:06:53 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-096b9644-d35a-4366-bdd7-114899617276 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Deleted volume successfully. Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Flow 'volume_create_manager' (a24290a8-b0bd-4b65-9a4f-1808c3de8e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76298e2-cd52-40a3-94ac-80835902c2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76298e2-cd52-40a3-94ac-80835902c2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2012616783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1984fc1-829c-44bd-92b8-d250b8d370fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ca6d87e28a469d904de52115a42255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:54Z,use_quota=True,user_id='2cf8224d97d44262bb3f5a0424ad1910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d01d60-9f33-4e1b-8901-9d1181c5ff72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d01d60-9f33-4e1b-8901-9d1181c5ff72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26981ed4-f89c-4e16-99d9-a209814d4aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26981ed4-f89c-4e16-99d9-a209814d4aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1984fc1-829c-44bd-92b8-d250b8d370fc', 'volume_name': 'volume-e1984fc1-829c-44bd-92b8-d250b8d370fc', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a66aca-0d78-4fd8-a685-fb75f944ea26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a66aca-0d78-4fd8-a685-fb75f944ea26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d079ae4-2c2b-425a-95f4-7c667908f0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:53 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Volume e1984fc1-829c-44bd-92b8-d250b8d370fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1984fc1-829c-44bd-92b8-d250b8d370fc', 'volume_size': 1} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-096b9644-d35a-4366-bdd7-114899617276 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-309f4ab9-855c-4d67-9dc4-a13c50ee0288-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:54 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d750107e-fa5a-4b19-a774-65831a3c7dcc 1073741824" returned: 0 in 0.745s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Flow 'volume_create_manager' (5c4659cd-01ac-4fa0-87b9-6b5b1f683c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd5743c-8c47-4caa-9302-6e8b19da5bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd5743c-8c47-4caa-9302-6e8b19da5bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1491308730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abfa0e6-b489-4c22-be5e-8cd3cd896442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ca6d87e28a469d904de52115a42255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:54Z,use_quota=True,user_id='2cf8224d97d44262bb3f5a0424ad1910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b43f20ea-0553-46c7-b097-393e46ca0430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b43f20ea-0553-46c7-b097-393e46ca0430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ad87d9-2d54-4358-8777-986ad8b029ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ad87d9-2d54-4358-8777-986ad8b029ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7abfa0e6-b489-4c22-be5e-8cd3cd896442', 'volume_name': 'volume-7abfa0e6-b489-4c22-be5e-8cd3cd896442', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e24e0d8-3c6d-41ca-807e-048e9450c6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e24e0d8-3c6d-41ca-807e-048e9450c6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caef304d-3ed4-4d86-accb-067358c86898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:54 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Volume 7abfa0e6-b489-4c22-be5e-8cd3cd896442: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7abfa0e6-b489-4c22-be5e-8cd3cd896442', 'volume_size': 1} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d750107e-fa5a-4b19-a774-65831a3c7dcc {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:54 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d750107e-fa5a-4b19-a774-65831a3c7dcc Sep 04 16:06:54 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:54 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d750107e-fa5a-4b19-a774-65831a3c7dcc" returned: 0 in 0.282s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.618s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2012616783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1984fc1-829c-44bd-92b8-d250b8d370fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ca6d87e28a469d904de52115a42255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:54Z,use_quota=True,user_id='2cf8224d97d44262bb3f5a0424ad1910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Creating volume e1984fc1-829c-44bd-92b8-d250b8d370fc {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:06:54 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e1984fc1-829c-44bd-92b8-d250b8d370fc 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa1fccc-fa74-4ecd-bd6d-fc2f96502d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d750107e-fa5a-4b19-a774-65831a3c7dcc', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:54 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e1984fc1-829c-44bd-92b8-d250b8d370fc 1073741824 Sep 04 16:06:54 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3b1c5d-64aa-4793-89a4-ad1ef58ebd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:54 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Volume volume-d750107e-fa5a-4b19-a774-65831a3c7dcc (d750107e-fa5a-4b19-a774-65831a3c7dcc): created successfully Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3b1c5d-64aa-4793-89a4-ad1ef58ebd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Flow 'volume_create_manager' (a4999b74-fa84-4833-9a41-3d2cd7885e71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:54 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-c99d6abe-aac0-440d-992b-36b3ee0c25ba tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Created volume successfully. Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-513bcf41-eb29-4b53-8bda-635bc81f19b1 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "cinder-fd542483-e960-45e1-8e8c-29d0b4fe4c20-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-513bcf41-eb29-4b53-8bda-635bc81f19b1 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-fd542483-e960-45e1-8e8c-29d0b4fe4c20-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-513bcf41-eb29-4b53-8bda-635bc81f19b1 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "cinder-quobyte-fd542483-e960-45e1-8e8c-29d0b4fe4c20" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-513bcf41-eb29-4b53-8bda-635bc81f19b1 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-quobyte-fd542483-e960-45e1-8e8c-29d0b4fe4c20" acquired by "delete_volume" :: waited 0.020s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-212cc1c2-fd32-40e4-9fad-8dde148db769 tempest-ProjectReaderTests-81314965 None] Acquiring lock "cinder-b34812ad-180f-4fc3-87c5-9a645c7f7fb8-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab72ad01-8b15-4f74-bc08-4ae10a88b653]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-513bcf41-eb29-4b53-8bda-635bc81f19b1 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd542483-e960-45e1-8e8c-29d0b4fe4c20 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-212cc1c2-fd32-40e4-9fad-8dde148db769 tempest-ProjectReaderTests-81314965 None] Lock "cinder-b34812ad-180f-4fc3-87c5-9a645c7f7fb8-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-212cc1c2-fd32-40e4-9fad-8dde148db769 tempest-ProjectReaderTests-81314965 None] Acquiring lock "cinder-quobyte-b34812ad-180f-4fc3-87c5-9a645c7f7fb8" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-212cc1c2-fd32-40e4-9fad-8dde148db769 tempest-ProjectReaderTests-81314965 None] Lock "cinder-quobyte-b34812ad-180f-4fc3-87c5-9a645c7f7fb8" acquired by "delete_volume" :: waited 0.038s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:55 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:55 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd542483-e960-45e1-8e8c-29d0b4fe4c20 Sep 04 16:06:55 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e1984fc1-829c-44bd-92b8-d250b8d370fc 1073741824" returned: 0 in 0.697s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[47abcf01-905c-4849-91da-72981adb7738]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-212cc1c2-fd32-40e4-9fad-8dde148db769 tempest-ProjectReaderTests-81314965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b34812ad-180f-4fc3-87c5-9a645c7f7fb8 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Flow 'volume_create_manager' (dd738498-750c-4b03-a69f-f1ef473e91d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:55 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b34812ad-180f-4fc3-87c5-9a645c7f7fb8 Sep 04 16:06:55 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff191aa-e9e0-48d5-9d9a-afd487a3df2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e1984fc1-829c-44bd-92b8-d250b8d370fc {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:55 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e1984fc1-829c-44bd-92b8-d250b8d370fc Sep 04 16:06:55 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff191aa-e9e0-48d5-9d9a-afd487a3df2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d88f76b-61b3-42c4-aafb-f558a36e11c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf7599483cf946a388a2f86d982ec2d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:55Z,use_quota=True,user_id='43297de0b1d0465a9de86162bcc9690c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7efd2bf-e46a-4ce6-b075-2e083e1f842d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7efd2bf-e46a-4ce6-b075-2e083e1f842d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74712ed3-5f50-4096-a2b2-744c8ec68380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.image.glance [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Creating Keystone auth plugin from conf {{(pid=87490) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Flow 'volume_create_manager' (7dc02f0d-d3aa-4b66-a62b-2e084ae72a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9aabe8-5124-4b57-babb-d044b4bcab4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9aabe8-5124-4b57-babb-d044b4bcab4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1388640611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ca6d87e28a469d904de52115a42255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:55Z,use_quota=True,user_id='2cf8224d97d44262bb3f5a0424ad1910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87de30ed-2016-4b17-8419-b7d900876cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87de30ed-2016-4b17-8419-b7d900876cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:55 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d160bca6-e4f6-4bbf-8c32-9791e1f154f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d160bca6-e4f6-4bbf-8c32-9791e1f154f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf', 'volume_name': 'volume-95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ab43fd-3b93-4a50-8441-50b7ff1cb976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ab43fd-3b93-4a50-8441-50b7ff1cb976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6b6875-5901-415b-8650-670ea625bada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:55 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Volume 95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf', 'volume_size': 1} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-513bcf41-eb29-4b53-8bda-635bc81f19b1 tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd542483-e960-45e1-8e8c-29d0b4fe4c20" returned: 0 in 0.685s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-513bcf41-eb29-4b53-8bda-635bc81f19b1 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd542483-e960-45e1-8e8c-29d0b4fe4c20 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:55 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd542483-e960-45e1-8e8c-29d0b4fe4c20 Sep 04 16:06:55 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:55 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:06:55 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Flow 'volume_create_manager' (9fe842c6-e562-4306-9de9-f2e6d7325a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019cf0e5-9472-4a65-8873-3071f64f3f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-212cc1c2-fd32-40e4-9fad-8dde148db769 tempest-ProjectReaderTests-81314965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b34812ad-180f-4fc3-87c5-9a645c7f7fb8" returned: 0 in 0.550s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-212cc1c2-fd32-40e4-9fad-8dde148db769 tempest-ProjectReaderTests-81314965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b34812ad-180f-4fc3-87c5-9a645c7f7fb8 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e1984fc1-829c-44bd-92b8-d250b8d370fc" returned: 0 in 0.379s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.611s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1491308730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abfa0e6-b489-4c22-be5e-8cd3cd896442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ca6d87e28a469d904de52115a42255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:54Z,use_quota=True,user_id='2cf8224d97d44262bb3f5a0424ad1910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Creating volume 7abfa0e6-b489-4c22-be5e-8cd3cd896442 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:55 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b34812ad-180f-4fc3-87c5-9a645c7f7fb8 Sep 04 16:06:55 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:06:55 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7abfa0e6-b489-4c22-be5e-8cd3cd896442 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019cf0e5-9472-4a65-8873-3071f64f3f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-259675759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfa75bd2-5523-46b6-822e-525a48a7d4db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ca6d87e28a469d904de52115a42255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:56Z,use_quota=True,user_id='2cf8224d97d44262bb3f5a0424ad1910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:55 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7abfa0e6-b489-4c22-be5e-8cd3cd896442 1073741824 Sep 04 16:06:55 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d681447-7295-4d03-a53f-6c80b4d8fce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d681447-7295-4d03-a53f-6c80b4d8fce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58fa09f0-694b-4c22-8438-a387532a8420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58fa09f0-694b-4c22-8438-a387532a8420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfa75bd2-5523-46b6-822e-525a48a7d4db', 'volume_name': 'volume-bfa75bd2-5523-46b6-822e-525a48a7d4db', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8bf4d02-258d-4737-a14d-ac5e9749c9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8bf4d02-258d-4737-a14d-ac5e9749c9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9b859e-cd8e-4eaa-a7cd-da55b2d70018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:55 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Volume bfa75bd2-5523-46b6-822e-525a48a7d4db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfa75bd2-5523-46b6-822e-525a48a7d4db', 'volume_size': 1} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d079ae4-2c2b-425a-95f4-7c667908f0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1984fc1-829c-44bd-92b8-d250b8d370fc', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:55 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47bf55fb-9b63-4bb6-be35-379a3d71bcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:56 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Volume volume-e1984fc1-829c-44bd-92b8-d250b8d370fc (e1984fc1-829c-44bd-92b8-d250b8d370fc): created successfully Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47bf55fb-9b63-4bb6-be35-379a3d71bcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Flow 'volume_create_manager' (a24290a8-b0bd-4b65-9a4f-1808c3de8e7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:56 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-ea8c6163-675b-4725-89f7-64bc72882dd2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Created volume successfully. Sep 04 16:06:56 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74712ed3-5f50-4096-a2b2-744c8ec68380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7d88f76b-61b3-42c4-aafb-f558a36e11c0', 'volume_name': 'volume-7d88f76b-61b3-42c4-aafb-f558a36e11c0', 'volume_size': 1, 'image_id': '7376ccb1-a07c-4c2b-94a1-e6699d4eef50', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7376ccb1-a07c-4c2b-94a1-e6699d4eef50', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'af0e29d0a8d9c685e3e2b4f8d2802fa4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bf7599483cf946a388a2f86d982ec2d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3bb77a426e83b2f877a5ad77ba7eed5c468e0fbe90820a1b49fc0d0f05124c7f94e45c81f1f7f4d844d8123d8e16679faa2f9b891812b4f65096dd62588ef674', 'id': '7376ccb1-a07c-4c2b-94a1-e6699d4eef50', 'created_at': datetime.datetime(2026, 9, 4, 14, 6, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 6, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7376ccb1-a07c-4c2b-94a1-e6699d4eef50/file', 'properties': {}}, 'image_service': }' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60dc2dba-e987-44c9-bf82-eab79d86194e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60dc2dba-e987-44c9-bf82-eab79d86194e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d5d3adc-a6f3-480a-bd39-b9ac93a9b183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:56 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Volume 7d88f76b-61b3-42c4-aafb-f558a36e11c0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7d88f76b-61b3-42c4-aafb-f558a36e11c0', 'volume_size': 1, 'image_id': '7376ccb1-a07c-4c2b-94a1-e6699d4eef50', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7376ccb1-a07c-4c2b-94a1-e6699d4eef50', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'af0e29d0a8d9c685e3e2b4f8d2802fa4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bf7599483cf946a388a2f86d982ec2d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3bb77a426e83b2f877a5ad77ba7eed5c468e0fbe90820a1b49fc0d0f05124c7f94e45c81f1f7f4d844d8123d8e16679faa2f9b891812b4f65096dd62588ef674', 'id': '7376ccb1-a07c-4c2b-94a1-e6699d4eef50', 'created_at': datetime.datetime(2026, 9, 4, 14, 6, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 6, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7376ccb1-a07c-4c2b-94a1-e6699d4eef50/file', 'properties': {}}, 'image_service': } Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Trying to clone 7d88f76b-61b3-42c4-aafb-f558a36e11c0 from image 7376ccb1-a07c-4c2b-94a1-e6699d4eef50 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7376ccb1-a07c-4c2b-94a1-e6699d4eef50', 'metadata': {}}]). {{(pid=87490) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-513bcf41-eb29-4b53-8bda-635bc81f19b1 tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-fd542483-e960-45e1-8e8c-29d0b4fe4c20" returned: 0 in 0.373s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-513bcf41-eb29-4b53-8bda-635bc81f19b1 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-quobyte-fd542483-e960-45e1-8e8c-29d0b4fe4c20" released by "delete_volume" :: held 1.129s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:56 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-212cc1c2-fd32-40e4-9fad-8dde148db769 tempest-ProjectReaderTests-81314965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-b34812ad-180f-4fc3-87c5-9a645c7f7fb8" returned: 0 in 0.383s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ezliq46ydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 16:06:56 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Image download 0.00 MB at 0.00 MB/s Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-513bcf41-eb29-4b53-8bda-635bc81f19b1 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Created reservations ['466907ee-3fbb-44fc-9bb2-8666997d9b18', '8ead36b7-8fdf-4a33-a2ab-cab6f8acceba', 'dae3d085-4436-43db-8c79-239d1a2d8e25', '125a2a69-8c8d-458d-8def-b1d8579677f4'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-212cc1c2-fd32-40e4-9fad-8dde148db769 tempest-ProjectReaderTests-81314965 None] Lock "cinder-quobyte-b34812ad-180f-4fc3-87c5-9a645c7f7fb8" released by "delete_volume" :: held 1.011s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c3d5e7-c766-4a58-bc86-8a677323e293]: (4, 'raw') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ezliq46ydevstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-513bcf41-eb29-4b53-8bda-635bc81f19b1 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-513bcf41-eb29-4b53-8bda-635bc81f19b1 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-513bcf41-eb29-4b53-8bda-635bc81f19b1 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-513bcf41-eb29-4b53-8bda-635bc81f19b1 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-513bcf41-eb29-4b53-8bda-635bc81f19b1 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-513bcf41-eb29-4b53-8bda-635bc81f19b1 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-212cc1c2-fd32-40e4-9fad-8dde148db769 tempest-ProjectReaderTests-81314965 None] Created reservations ['82339fc4-ff32-424c-a9d9-b39c0f48332b', '0d387ecf-efab-438e-b9fb-347934290646', '5680532c-0d65-45db-84d3-2090c282c77b', 'eb1cd37a-e2ab-4906-80c0-a7e2b452de4e'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:06:56 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:06:56 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:56 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ezliq46ydevstack@QuobyteHD Sep 04 16:06:56 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:56 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7abfa0e6-b489-4c22-be5e-8cd3cd896442 1073741824" returned: 0 in 0.575s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-212cc1c2-fd32-40e4-9fad-8dde148db769 tempest-ProjectReaderTests-81314965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-212cc1c2-fd32-40e4-9fad-8dde148db769 tempest-ProjectReaderTests-81314965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-212cc1c2-fd32-40e4-9fad-8dde148db769 tempest-ProjectReaderTests-81314965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-212cc1c2-fd32-40e4-9fad-8dde148db769 tempest-ProjectReaderTests-81314965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-212cc1c2-fd32-40e4-9fad-8dde148db769 tempest-ProjectReaderTests-81314965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-212cc1c2-fd32-40e4-9fad-8dde148db769 tempest-ProjectReaderTests-81314965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:56 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7abfa0e6-b489-4c22-be5e-8cd3cd896442 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:56 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:56 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7abfa0e6-b489-4c22-be5e-8cd3cd896442 Sep 04 16:06:56 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:56 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-513bcf41-eb29-4b53-8bda-635bc81f19b1 tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.352s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-513bcf41-eb29-4b53-8bda-635bc81f19b1 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:06:56 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-513bcf41-eb29-4b53-8bda-635bc81f19b1 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Deleted volume successfully. Sep 04 16:06:56 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ezliq46ydevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ezliq46ydevstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-513bcf41-eb29-4b53-8bda-635bc81f19b1 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-fd542483-e960-45e1-8e8c-29d0b4fe4c20-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:56 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7abfa0e6-b489-4c22-be5e-8cd3cd896442" returned: 0 in 0.284s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.077s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1388640611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ca6d87e28a469d904de52115a42255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:55Z,use_quota=True,user_id='2cf8224d97d44262bb3f5a0424ad1910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Creating volume 95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:06:56 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:56 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caef304d-3ed4-4d86-accb-067358c86898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7abfa0e6-b489-4c22-be5e-8cd3cd896442', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c008bd16-1a98-41e9-a5b7-d5ffb2675253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:56 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf 1073741824 Sep 04 16:06:56 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-212cc1c2-fd32-40e4-9fad-8dde148db769 tempest-ProjectReaderTests-81314965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.357s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-212cc1c2-fd32-40e4-9fad-8dde148db769 tempest-ProjectReaderTests-81314965 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:06:56 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-212cc1c2-fd32-40e4-9fad-8dde148db769 tempest-ProjectReaderTests-81314965 None] Deleted volume successfully. Sep 04 16:06:56 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Volume volume-7abfa0e6-b489-4c22-be5e-8cd3cd896442 (7abfa0e6-b489-4c22-be5e-8cd3cd896442): created successfully Sep 04 16:06:56 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ezliq46ydevstack@QuobyteHD Sep 04 16:06:56 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c008bd16-1a98-41e9-a5b7-d5ffb2675253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Flow 'volume_create_manager' (5c4659cd-01ac-4fa0-87b9-6b5b1f683c38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:56 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-2ad32f35-352e-4591-9157-235e82e81f23 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Created volume successfully. Sep 04 16:06:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-212cc1c2-fd32-40e4-9fad-8dde148db769 tempest-ProjectReaderTests-81314965 None] Lock "cinder-b34812ad-180f-4fc3-87c5-9a645c7f7fb8-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:57 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ezliq46ydevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ezliq46ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Temporary image 7376ccb1-a07c-4c2b-94a1-e6699d4eef50 is fetched for user 43297de0b1d0465a9de86162bcc9690c. {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-8288b537-9b44-470a-bf26-158645abf99a tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "cinder-207943cc-2f79-412f-bf0a-c0725f51df27-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adc9c9e-ef63-40b4-87fc-4d4a8b624116]: (4, 'raw') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ezliq46ydevstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-8288b537-9b44-470a-bf26-158645abf99a tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-207943cc-2f79-412f-bf0a-c0725f51df27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-8288b537-9b44-470a-bf26-158645abf99a tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "cinder-quobyte-e530049f-5348-4d89-baa3-8a3ad7c1d8a6" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-8288b537-9b44-470a-bf26-158645abf99a tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-quobyte-e530049f-5348-4d89-baa3-8a3ad7c1d8a6" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-8288b537-9b44-470a-bf26-158645abf99a tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "cinder-quobyte-207943cc-2f79-412f-bf0a-c0725f51df27" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-8288b537-9b44-470a-bf26-158645abf99a tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-quobyte-207943cc-2f79-412f-bf0a-c0725f51df27" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-8288b537-9b44-470a-bf26-158645abf99a tempest-CreateVolumesFromSnapshotTest-1582167689 None] Deleting offline snapshot 207943cc-2f79-412f-bf0a-c0725f51df27 of volume e530049f-5348-4d89-baa3-8a3ad7c1d8a6 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-8288b537-9b44-470a-bf26-158645abf99a tempest-CreateVolumesFromSnapshotTest-1582167689 None] snapshot_file for this snap is: volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6.207943cc-2f79-412f-bf0a-c0725f51df27 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[986a1ac3-65f8-4859-97fa-ed74df2043ac]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8288b537-9b44-470a-bf26-158645abf99a tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6.207943cc-2f79-412f-bf0a-c0725f51df27 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:57 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:57 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ezliq46ydevstack@QuobyteHD Sep 04 16:06:57 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf 1073741824" returned: 0 in 0.538s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:57 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6.207943cc-2f79-412f-bf0a-c0725f51df27 Sep 04 16:06:57 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:57 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf Sep 04 16:06:57 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:57 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ezliq46ydevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ezliq46ydevstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:57 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf" returned: 0 in 0.276s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.733s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-259675759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfa75bd2-5523-46b6-822e-525a48a7d4db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ca6d87e28a469d904de52115a42255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:56Z,use_quota=True,user_id='2cf8224d97d44262bb3f5a0424ad1910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Creating volume bfa75bd2-5523-46b6-822e-525a48a7d4db {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:06:57 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bfa75bd2-5523-46b6-822e-525a48a7d4db 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:57 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8288b537-9b44-470a-bf26-158645abf99a tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6.207943cc-2f79-412f-bf0a-c0725f51df27" returned: 0 in 0.426s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-8288b537-9b44-470a-bf26-158645abf99a tempest-CreateVolumesFromSnapshotTest-1582167689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:06:57 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bfa75bd2-5523-46b6-822e-525a48a7d4db 1073741824 Sep 04 16:06:57 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:57 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ezliq46ydevstack@QuobyteHD Sep 04 16:06:57 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6b6875-5901-415b-8650-670ea625bada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bdd571c-3323-4c74-96e8-7a905ab137e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc119f9e-3bbb-4274-9511-4ca8debd4538]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8288b537-9b44-470a-bf26-158645abf99a tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:57 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Volume volume-95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf (95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf): created successfully Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bdd571c-3323-4c74-96e8-7a905ab137e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Flow 'volume_create_manager' (7dc02f0d-d3aa-4b66-a62b-2e084ae72a13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:57 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-b45cda41-ac5c-40e2-a266-b2f9780497bb tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Created volume successfully. Sep 04 16:06:58 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6 Sep 04 16:06:58 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:58 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ezliq46ydevstack@QuobyteHD" returned: 1 in 0.526s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ezliq46ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:06:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:58 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bfa75bd2-5523-46b6-822e-525a48a7d4db 1073741824" returned: 0 in 0.546s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bfa75bd2-5523-46b6-822e-525a48a7d4db {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:58 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bfa75bd2-5523-46b6-822e-525a48a7d4db Sep 04 16:06:58 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8288b537-9b44-470a-bf26-158645abf99a tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6" returned: 0 in 0.513s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:58 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8288b537-9b44-470a-bf26-158645abf99a tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6.207943cc-2f79-412f-bf0a-c0725f51df27 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:58 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6.207943cc-2f79-412f-bf0a-c0725f51df27 Sep 04 16:06:58 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:58 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bfa75bd2-5523-46b6-822e-525a48a7d4db" returned: 0 in 0.272s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:06:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.420s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d88f76b-61b3-42c4-aafb-f558a36e11c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf7599483cf946a388a2f86d982ec2d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:06:55Z,use_quota=True,user_id='43297de0b1d0465a9de86162bcc9690c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:06:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Creating volume 7d88f76b-61b3-42c4-aafb-f558a36e11c0 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:06:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:06:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:06:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:06:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:06:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:06:58 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:06:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7d88f76b-61b3-42c4-aafb-f558a36e11c0 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9b859e-cd8e-4eaa-a7cd-da55b2d70018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfa75bd2-5523-46b6-822e-525a48a7d4db', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:58 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7d88f76b-61b3-42c4-aafb-f558a36e11c0 1073741824 Sep 04 16:06:58 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92911366-c2d7-4328-a06e-7c40034ebd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:06:58 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Volume volume-bfa75bd2-5523-46b6-822e-525a48a7d4db (bfa75bd2-5523-46b6-822e-525a48a7d4db): created successfully Sep 04 16:06:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92911366-c2d7-4328-a06e-7c40034ebd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:06:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Flow 'volume_create_manager' (9fe842c6-e562-4306-9de9-f2e6d7325a7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:06:58 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-56ccd9cf-95d7-406b-9120-3b01641f2484 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Created volume successfully. Sep 04 16:06:58 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8288b537-9b44-470a-bf26-158645abf99a tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6.207943cc-2f79-412f-bf0a-c0725f51df27" returned: 0 in 0.403s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8288b537-9b44-470a-bf26-158645abf99a tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6.207943cc-2f79-412f-bf0a-c0725f51df27 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:58 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6.207943cc-2f79-412f-bf0a-c0725f51df27 Sep 04 16:06:58 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:59 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8288b537-9b44-470a-bf26-158645abf99a tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6.207943cc-2f79-412f-bf0a-c0725f51df27" returned: 0 in 0.317s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:59 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-8288b537-9b44-470a-bf26-158645abf99a tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-quobyte-207943cc-2f79-412f-bf0a-c0725f51df27" released by "_delete_snapshot" :: held 1.853s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:59 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-8288b537-9b44-470a-bf26-158645abf99a tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-quobyte-e530049f-5348-4d89-baa3-8a3ad7c1d8a6" released by "delete_snapshot" :: held 1.896s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:59 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7d88f76b-61b3-42c4-aafb-f558a36e11c0 1073741824" returned: 0 in 0.597s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:59 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-688786dc-c2ca-44b1-860b-feba5ab59650 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "cinder-bfa75bd2-5523-46b6-822e-525a48a7d4db-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:59 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-688786dc-c2ca-44b1-860b-feba5ab59650 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "cinder-bfa75bd2-5523-46b6-822e-525a48a7d4db-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7d88f76b-61b3-42c4-aafb-f558a36e11c0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:59 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7d88f76b-61b3-42c4-aafb-f558a36e11c0 Sep 04 16:06:59 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:59 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-688786dc-c2ca-44b1-860b-feba5ab59650 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "cinder-quobyte-bfa75bd2-5523-46b6-822e-525a48a7d4db" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:06:59 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-688786dc-c2ca-44b1-860b-feba5ab59650 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "cinder-quobyte-bfa75bd2-5523-46b6-822e-525a48a7d4db" acquired by "delete_volume" :: waited 0.029s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:06:59 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-8288b537-9b44-470a-bf26-158645abf99a tempest-CreateVolumesFromSnapshotTest-1582167689 None] Created reservations ['20641bcd-a9d8-4445-8ad9-92acc79ecfb9', 'b9956af5-5d0e-406f-9a3f-3d85d25dfbdd', 'dfe18fa4-8dec-489b-8fad-4d90db4e09b5', 'df525c38-f467-4c0a-9d6b-c5a94abdaeaf'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:06:59 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2fc0d4-4cde-4a88-9e83-6ac27d7aa186]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-688786dc-c2ca-44b1-860b-feba5ab59650 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bfa75bd2-5523-46b6-822e-525a48a7d4db {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:59 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-8288b537-9b44-470a-bf26-158645abf99a tempest-CreateVolumesFromSnapshotTest-1582167689 None] Delete snapshot completed successfully. Sep 04 16:06:59 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-8288b537-9b44-470a-bf26-158645abf99a tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-207943cc-2f79-412f-bf0a-c0725f51df27-delete_snapshot" released by "delete_snapshot" :: held 2.262s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:06:59 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bfa75bd2-5523-46b6-822e-525a48a7d4db Sep 04 16:06:59 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:59 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7d88f76b-61b3-42c4-aafb-f558a36e11c0" returned: 0 in 0.329s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:59 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:06:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:06:59 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Attempting download of 7376ccb1-a07c-4c2b-94a1-e6699d4eef50 ((None, [{'url': 'file:///opt/stack/data/glance/images/7376ccb1-a07c-4c2b-94a1-e6699d4eef50', 'metadata': {}}])) to volume 7d88f76b-61b3-42c4-aafb-f558a36e11c0. {{(pid=87490) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 16:06:59 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[45489e0c-c147-437a-982a-f70fc2e4955d]: (4, 'raw') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:06:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ul47uy8q {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:59 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Sep 04 16:06:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-688786dc-c2ca-44b1-860b-feba5ab59650 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bfa75bd2-5523-46b6-822e-525a48a7d4db" returned: 0 in 0.379s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:06:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-688786dc-c2ca-44b1-860b-feba5ab59650 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bfa75bd2-5523-46b6-822e-525a48a7d4db {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:06:59 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bfa75bd2-5523-46b6-822e-525a48a7d4db Sep 04 16:06:59 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:06:59 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ul47uy8q Sep 04 16:06:59 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:00 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-688786dc-c2ca-44b1-860b-feba5ab59650 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bfa75bd2-5523-46b6-822e-525a48a7d4db" returned: 0 in 0.270s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:00 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ul47uy8q" returned: 0 in 0.370s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ul47uy8q {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-688786dc-c2ca-44b1-860b-feba5ab59650 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "cinder-quobyte-bfa75bd2-5523-46b6-822e-525a48a7d4db" released by "delete_volume" :: held 0.729s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-688786dc-c2ca-44b1-860b-feba5ab59650 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Created reservations ['3c71fcff-42b6-4454-bee2-a4675d6d66c0', '4b032710-9c76-48ad-a1ef-3288987ce9d2', '3bc68a5f-0fa0-454f-bfc2-ae08a231c4df', '875748ab-d3f3-4fd3-8149-7899f6fe51f9'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:00 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ul47uy8q Sep 04 16:07:00 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-688786dc-c2ca-44b1-860b-feba5ab59650 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-688786dc-c2ca-44b1-860b-feba5ab59650 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-688786dc-c2ca-44b1-860b-feba5ab59650 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-688786dc-c2ca-44b1-860b-feba5ab59650 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-688786dc-c2ca-44b1-860b-feba5ab59650 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-688786dc-c2ca-44b1-860b-feba5ab59650 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:00 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:07:00 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:00 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ul47uy8q" returned: 1 in 0.452s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ul47uy8q' failed. Not Retrying. {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cecba15-a9f7-40f5-9d62-53b500ddea09]: (4, 'raw') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ezliq46ydevstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-080859d6-d16a-4e86-bb5f-a16a32d31a67 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "cinder-95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-080859d6-d16a-4e86-bb5f-a16a32d31a67 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "cinder-95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:00 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ezliq46ydevstack@QuobyteHD Sep 04 16:07:00 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:00 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-688786dc-c2ca-44b1-860b-feba5ab59650 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.408s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-688786dc-c2ca-44b1-860b-feba5ab59650 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-080859d6-d16a-4e86-bb5f-a16a32d31a67 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "cinder-quobyte-95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:00 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-688786dc-c2ca-44b1-860b-feba5ab59650 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Deleted volume successfully. Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4c5f477e-9fdb-4892-bb40-1b79f8515377 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "cinder-e530049f-5348-4d89-baa3-8a3ad7c1d8a6-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-080859d6-d16a-4e86-bb5f-a16a32d31a67 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "cinder-quobyte-95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf" acquired by "delete_volume" :: waited 0.050s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4c5f477e-9fdb-4892-bb40-1b79f8515377 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-e530049f-5348-4d89-baa3-8a3ad7c1d8a6-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-688786dc-c2ca-44b1-860b-feba5ab59650 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "cinder-bfa75bd2-5523-46b6-822e-525a48a7d4db-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba90033-4e64-40aa-b3c2-ac0b018e81b4]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-080859d6-d16a-4e86-bb5f-a16a32d31a67 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4c5f477e-9fdb-4892-bb40-1b79f8515377 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "cinder-quobyte-e530049f-5348-4d89-baa3-8a3ad7c1d8a6" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4c5f477e-9fdb-4892-bb40-1b79f8515377 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-quobyte-e530049f-5348-4d89-baa3-8a3ad7c1d8a6" acquired by "delete_volume" :: waited 0.019s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[40569df3-4368-4f93-a045-c7abb40659d7]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4c5f477e-9fdb-4892-bb40-1b79f8515377 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:00 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf Sep 04 16:07:00 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:00 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ezliq46ydevstack@QuobyteHD" returned: 0 in 0.465s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ezliq46ydevstack@QuobyteHD {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:01 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6 Sep 04 16:07:01 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:01 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ezliq46ydevstack@QuobyteHD Sep 04 16:07:01 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:01 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-080859d6-d16a-4e86-bb5f-a16a32d31a67 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf" returned: 0 in 0.468s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-080859d6-d16a-4e86-bb5f-a16a32d31a67 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:01 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf Sep 04 16:07:01 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:01 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4c5f477e-9fdb-4892-bb40-1b79f8515377 tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6" returned: 0 in 0.419s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4c5f477e-9fdb-4892-bb40-1b79f8515377 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:01 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6 Sep 04 16:07:01 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:01 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ezliq46ydevstack@QuobyteHD" returned: 1 in 0.389s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ezliq46ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] 7376ccb1-a07c-4c2b-94a1-e6699d4eef50 was raw, converting to qcow2 {{(pid=87490) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ezliq46ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7d88f76b-61b3-42c4-aafb-f558a36e11c0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:01 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ezliq46ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7d88f76b-61b3-42c4-aafb-f558a36e11c0 Sep 04 16:07:01 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:01 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-080859d6-d16a-4e86-bb5f-a16a32d31a67 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf" returned: 0 in 0.281s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-080859d6-d16a-4e86-bb5f-a16a32d31a67 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "cinder-quobyte-95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf" released by "delete_volume" :: held 0.822s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:01 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4c5f477e-9fdb-4892-bb40-1b79f8515377 tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e530049f-5348-4d89-baa3-8a3ad7c1d8a6" returned: 0 in 0.319s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-080859d6-d16a-4e86-bb5f-a16a32d31a67 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Created reservations ['208f0bd3-3c1b-4399-94fa-ff6daf5ae2e8', 'd5faa47e-facf-4698-9eeb-2645199d869c', 'b60befb8-6ba2-4c10-b197-7d30bf3d7f70', 'ba0a122e-945c-4807-bdda-0e9bf845bfb1'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4c5f477e-9fdb-4892-bb40-1b79f8515377 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-quobyte-e530049f-5348-4d89-baa3-8a3ad7c1d8a6" released by "delete_volume" :: held 0.819s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-4c5f477e-9fdb-4892-bb40-1b79f8515377 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Created reservations ['ce8377a4-c217-403a-a6cf-c31608274e15', '7c298253-836f-45ef-a143-762471d40791', 'a8268a6d-7475-4d97-991c-64bbe0f0e9d9', 'b048cba8-0038-4269-aaed-4cec07714cbf'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-080859d6-d16a-4e86-bb5f-a16a32d31a67 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-080859d6-d16a-4e86-bb5f-a16a32d31a67 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-080859d6-d16a-4e86-bb5f-a16a32d31a67 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-080859d6-d16a-4e86-bb5f-a16a32d31a67 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-080859d6-d16a-4e86-bb5f-a16a32d31a67 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-080859d6-d16a-4e86-bb5f-a16a32d31a67 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d9c1668f-9fad-4b38-abc8-2983cc40f84c tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "cinder-7abfa0e6-b489-4c22-be5e-8cd3cd896442-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:01 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:07:01 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d9c1668f-9fad-4b38-abc8-2983cc40f84c tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "cinder-7abfa0e6-b489-4c22-be5e-8cd3cd896442-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4c5f477e-9fdb-4892-bb40-1b79f8515377 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4c5f477e-9fdb-4892-bb40-1b79f8515377 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4c5f477e-9fdb-4892-bb40-1b79f8515377 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-4c5f477e-9fdb-4892-bb40-1b79f8515377 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4c5f477e-9fdb-4892-bb40-1b79f8515377 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4c5f477e-9fdb-4892-bb40-1b79f8515377 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d9c1668f-9fad-4b38-abc8-2983cc40f84c tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "cinder-quobyte-7abfa0e6-b489-4c22-be5e-8cd3cd896442" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:01 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:07:01 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d9c1668f-9fad-4b38-abc8-2983cc40f84c tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "cinder-quobyte-7abfa0e6-b489-4c22-be5e-8cd3cd896442" acquired by "delete_volume" :: waited 0.025s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:02 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[f636c4ad-7ad2-44e8-b18f-c6e889a36602]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9c1668f-9fad-4b38-abc8-2983cc40f84c tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7abfa0e6-b489-4c22-be5e-8cd3cd896442 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:02 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ezliq46ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7d88f76b-61b3-42c4-aafb-f558a36e11c0" returned: 0 in 0.724s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:02 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7376ccb1-a07c-4c2b-94a1-e6699d4eef50_ezliq46ydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7d88f76b-61b3-42c4-aafb-f558a36e11c0 {{(pid=87490) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 16:07:02 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Converted 0.00 MB image at 0.00 MB/s Sep 04 16:07:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7d88f76b-61b3-42c4-aafb-f558a36e11c0 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:02 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7d88f76b-61b3-42c4-aafb-f558a36e11c0 1G Sep 04 16:07:02 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:02 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7abfa0e6-b489-4c22-be5e-8cd3cd896442 Sep 04 16:07:02 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:02 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:02 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4c5f477e-9fdb-4892-bb40-1b79f8515377 tempest-CreateVolumesFromSnapshotTest-1582167689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.373s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-080859d6-d16a-4e86-bb5f-a16a32d31a67 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.483s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:02 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-4c5f477e-9fdb-4892-bb40-1b79f8515377 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:07:02 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-080859d6-d16a-4e86-bb5f-a16a32d31a67 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:07:02 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-4c5f477e-9fdb-4892-bb40-1b79f8515377 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Deleted volume successfully. Sep 04 16:07:02 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-080859d6-d16a-4e86-bb5f-a16a32d31a67 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Deleted volume successfully. Sep 04 16:07:02 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4c5f477e-9fdb-4892-bb40-1b79f8515377 tempest-CreateVolumesFromSnapshotTest-1582167689 None] Lock "cinder-e530049f-5348-4d89-baa3-8a3ad7c1d8a6-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:02 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-080859d6-d16a-4e86-bb5f-a16a32d31a67 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "cinder-95b3eb10-ecaf-4a27-970d-2ab0ef4a06bf-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:02 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9c1668f-9fad-4b38-abc8-2983cc40f84c tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7abfa0e6-b489-4c22-be5e-8cd3cd896442" returned: 0 in 0.589s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9c1668f-9fad-4b38-abc8-2983cc40f84c tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7abfa0e6-b489-4c22-be5e-8cd3cd896442 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:02 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7abfa0e6-b489-4c22-be5e-8cd3cd896442 Sep 04 16:07:02 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:02 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7d88f76b-61b3-42c4-aafb-f558a36e11c0 1G" returned: 0 in 0.540s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:02 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Downloaded image 7376ccb1-a07c-4c2b-94a1-e6699d4eef50 ((None, [{'url': 'file:///opt/stack/data/glance/images/7376ccb1-a07c-4c2b-94a1-e6699d4eef50', 'metadata': {}}])) to volume 7d88f76b-61b3-42c4-aafb-f558a36e11c0 successfully. {{(pid=87490) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 16:07:02 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Temporary image 7376ccb1-a07c-4c2b-94a1-e6699d4eef50 for user 43297de0b1d0465a9de86162bcc9690c is deleted. {{(pid=87490) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 16:07:02 devstack cinder-volume[87490]: DEBUG cinder.volume.volume_utils [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Marking volume 7d88f76b-61b3-42c4-aafb-f558a36e11c0 as bootable. {{(pid=87490) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 16:07:02 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Copying metadata from image 7376ccb1-a07c-4c2b-94a1-e6699d4eef50 to 7d88f76b-61b3-42c4-aafb-f558a36e11c0. {{(pid=87490) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 16:07:02 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Creating volume glance metadata for volume 7d88f76b-61b3-42c4-aafb-f558a36e11c0 backed by image 7376ccb1-a07c-4c2b-94a1-e6699d4eef50 with: {'image_id': '7376ccb1-a07c-4c2b-94a1-e6699d4eef50', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'af0e29d0a8d9c685e3e2b4f8d2802fa4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87490) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 16:07:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d5d3adc-a6f3-480a-bd39-b9ac93a9b183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d88f76b-61b3-42c4-aafb-f558a36e11c0', 'volume_size': 1, 'image_id': '7376ccb1-a07c-4c2b-94a1-e6699d4eef50', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7376ccb1-a07c-4c2b-94a1-e6699d4eef50', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'af0e29d0a8d9c685e3e2b4f8d2802fa4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bf7599483cf946a388a2f86d982ec2d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3bb77a426e83b2f877a5ad77ba7eed5c468e0fbe90820a1b49fc0d0f05124c7f94e45c81f1f7f4d844d8123d8e16679faa2f9b891812b4f65096dd62588ef674', 'id': '7376ccb1-a07c-4c2b-94a1-e6699d4eef50', 'created_at': datetime.datetime(2026, 9, 4, 14, 6, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 14, 6, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7376ccb1-a07c-4c2b-94a1-e6699d4eef50/file', 'properties': {}}, 'image_service': }' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad1577d-4a94-4a3e-a423-bd8e54c62fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:02 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Volume volume-7d88f76b-61b3-42c4-aafb-f558a36e11c0 (7d88f76b-61b3-42c4-aafb-f558a36e11c0): created successfully Sep 04 16:07:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad1577d-4a94-4a3e-a423-bd8e54c62fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Flow 'volume_create_manager' (dd738498-750c-4b03-a69f-f1ef473e91d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:02 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-984c0bc4-7ab6-43d9-ad81-023b709d35e6 tempest-VolumeImageDependencyTests-151807995 None] Created volume successfully. Sep 04 16:07:02 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9c1668f-9fad-4b38-abc8-2983cc40f84c tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7abfa0e6-b489-4c22-be5e-8cd3cd896442" returned: 0 in 0.326s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:02 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d9c1668f-9fad-4b38-abc8-2983cc40f84c tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "cinder-quobyte-7abfa0e6-b489-4c22-be5e-8cd3cd896442" released by "delete_volume" :: held 0.971s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:03 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-d9c1668f-9fad-4b38-abc8-2983cc40f84c tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Created reservations ['16947498-3009-4d6b-9858-0e67091de82c', '090b2614-3b54-4e16-85c3-f6d295ac2544', '544fe6fa-5a99-4276-8845-95e859920026', '61036472-6dc5-454d-b074-7ddef3ef4109'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9c1668f-9fad-4b38-abc8-2983cc40f84c tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9c1668f-9fad-4b38-abc8-2983cc40f84c tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9c1668f-9fad-4b38-abc8-2983cc40f84c tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9c1668f-9fad-4b38-abc8-2983cc40f84c tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9c1668f-9fad-4b38-abc8-2983cc40f84c tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9c1668f-9fad-4b38-abc8-2983cc40f84c tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:03 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:07:03 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:03 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9c1668f-9fad-4b38-abc8-2983cc40f84c tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.287s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:03 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d9c1668f-9fad-4b38-abc8-2983cc40f84c tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:07:03 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-d9c1668f-9fad-4b38-abc8-2983cc40f84c tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Deleted volume successfully. Sep 04 16:07:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d9c1668f-9fad-4b38-abc8-2983cc40f84c tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "cinder-7abfa0e6-b489-4c22-be5e-8cd3cd896442-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c176f7e1-56c2-4f44-a235-eb5955b944ef tempest-VolumeImageDependencyTests-151807995 None] Acquiring lock "cinder-7d88f76b-61b3-42c4-aafb-f558a36e11c0-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c176f7e1-56c2-4f44-a235-eb5955b944ef tempest-VolumeImageDependencyTests-151807995 None] Lock "cinder-7d88f76b-61b3-42c4-aafb-f558a36e11c0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:04 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c176f7e1-56c2-4f44-a235-eb5955b944ef tempest-VolumeImageDependencyTests-151807995 None] Acquiring lock "cinder-quobyte-7d88f76b-61b3-42c4-aafb-f558a36e11c0" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:04 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c176f7e1-56c2-4f44-a235-eb5955b944ef tempest-VolumeImageDependencyTests-151807995 None] Lock "cinder-quobyte-7d88f76b-61b3-42c4-aafb-f558a36e11c0" acquired by "delete_volume" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:04 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a42fd9-87a2-41f2-9657-c44f32f14665]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c176f7e1-56c2-4f44-a235-eb5955b944ef tempest-VolumeImageDependencyTests-151807995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7d88f76b-61b3-42c4-aafb-f558a36e11c0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:04 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7d88f76b-61b3-42c4-aafb-f558a36e11c0 Sep 04 16:07:04 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:04 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-46c9c7ff-882f-4315-85b3-fa06a6ebc9b2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "cinder-e1984fc1-829c-44bd-92b8-d250b8d370fc-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:04 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-46c9c7ff-882f-4315-85b3-fa06a6ebc9b2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "cinder-e1984fc1-829c-44bd-92b8-d250b8d370fc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:04 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-46c9c7ff-882f-4315-85b3-fa06a6ebc9b2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "cinder-quobyte-e1984fc1-829c-44bd-92b8-d250b8d370fc" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:04 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-46c9c7ff-882f-4315-85b3-fa06a6ebc9b2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "cinder-quobyte-e1984fc1-829c-44bd-92b8-d250b8d370fc" acquired by "delete_volume" :: waited 0.025s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:04 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c92adc-ca6f-4207-bab5-be0a88fcd32b]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-46c9c7ff-882f-4315-85b3-fa06a6ebc9b2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e1984fc1-829c-44bd-92b8-d250b8d370fc {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:04 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e1984fc1-829c-44bd-92b8-d250b8d370fc Sep 04 16:07:04 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:04 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c176f7e1-56c2-4f44-a235-eb5955b944ef tempest-VolumeImageDependencyTests-151807995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7d88f76b-61b3-42c4-aafb-f558a36e11c0" returned: 0 in 0.600s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c176f7e1-56c2-4f44-a235-eb5955b944ef tempest-VolumeImageDependencyTests-151807995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7d88f76b-61b3-42c4-aafb-f558a36e11c0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:04 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7d88f76b-61b3-42c4-aafb-f558a36e11c0 Sep 04 16:07:04 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:04 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-46c9c7ff-882f-4315-85b3-fa06a6ebc9b2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e1984fc1-829c-44bd-92b8-d250b8d370fc" returned: 0 in 0.479s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-46c9c7ff-882f-4315-85b3-fa06a6ebc9b2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e1984fc1-829c-44bd-92b8-d250b8d370fc {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:04 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e1984fc1-829c-44bd-92b8-d250b8d370fc Sep 04 16:07:04 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:05 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c176f7e1-56c2-4f44-a235-eb5955b944ef tempest-VolumeImageDependencyTests-151807995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7d88f76b-61b3-42c4-aafb-f558a36e11c0" returned: 0 in 0.338s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:05 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c176f7e1-56c2-4f44-a235-eb5955b944ef tempest-VolumeImageDependencyTests-151807995 None] Lock "cinder-quobyte-7d88f76b-61b3-42c4-aafb-f558a36e11c0" released by "delete_volume" :: held 0.996s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:05 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-c176f7e1-56c2-4f44-a235-eb5955b944ef tempest-VolumeImageDependencyTests-151807995 None] Created reservations ['eced8ae4-0bdf-452e-bc33-0ff7033d29f3', 'da77446b-381c-42bb-98f2-6db1905de676', '4aed90c8-e386-4d92-8eca-73cda3adee2a', '53db2e39-b9be-4b8f-ab57-6435136d509c'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:05 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-46c9c7ff-882f-4315-85b3-fa06a6ebc9b2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-e1984fc1-829c-44bd-92b8-d250b8d370fc" returned: 0 in 0.348s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:05 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-46c9c7ff-882f-4315-85b3-fa06a6ebc9b2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "cinder-quobyte-e1984fc1-829c-44bd-92b8-d250b8d370fc" released by "delete_volume" :: held 0.900s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c176f7e1-56c2-4f44-a235-eb5955b944ef tempest-VolumeImageDependencyTests-151807995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c176f7e1-56c2-4f44-a235-eb5955b944ef tempest-VolumeImageDependencyTests-151807995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:05 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c176f7e1-56c2-4f44-a235-eb5955b944ef tempest-VolumeImageDependencyTests-151807995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:05 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-c176f7e1-56c2-4f44-a235-eb5955b944ef tempest-VolumeImageDependencyTests-151807995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-c176f7e1-56c2-4f44-a235-eb5955b944ef tempest-VolumeImageDependencyTests-151807995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c176f7e1-56c2-4f44-a235-eb5955b944ef tempest-VolumeImageDependencyTests-151807995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:05 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-46c9c7ff-882f-4315-85b3-fa06a6ebc9b2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Created reservations ['ba9526cc-7f5f-4b6f-9777-eaaca7765d71', '3c57dc1c-4c6c-49ba-851a-1a9ad9476bea', '028fb49f-32f1-4bb6-b5d1-6b47afe1d761', 'b6901bfe-bf96-4c63-8e15-6e768f1f3623'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:05 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:07:05 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-46c9c7ff-882f-4315-85b3-fa06a6ebc9b2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-46c9c7ff-882f-4315-85b3-fa06a6ebc9b2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:05 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-46c9c7ff-882f-4315-85b3-fa06a6ebc9b2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:05 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-46c9c7ff-882f-4315-85b3-fa06a6ebc9b2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-46c9c7ff-882f-4315-85b3-fa06a6ebc9b2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-46c9c7ff-882f-4315-85b3-fa06a6ebc9b2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:05 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:07:05 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:05 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-c176f7e1-56c2-4f44-a235-eb5955b944ef tempest-VolumeImageDependencyTests-151807995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.340s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:05 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-c176f7e1-56c2-4f44-a235-eb5955b944ef tempest-VolumeImageDependencyTests-151807995 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:07:05 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-c176f7e1-56c2-4f44-a235-eb5955b944ef tempest-VolumeImageDependencyTests-151807995 None] Deleted volume successfully. Sep 04 16:07:05 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-c176f7e1-56c2-4f44-a235-eb5955b944ef tempest-VolumeImageDependencyTests-151807995 None] Lock "cinder-7d88f76b-61b3-42c4-aafb-f558a36e11c0-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:05 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-46c9c7ff-882f-4315-85b3-fa06a6ebc9b2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.364s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:05 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-46c9c7ff-882f-4315-85b3-fa06a6ebc9b2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:07:05 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-46c9c7ff-882f-4315-85b3-fa06a6ebc9b2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Deleted volume successfully. Sep 04 16:07:05 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-46c9c7ff-882f-4315-85b3-fa06a6ebc9b2 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "cinder-e1984fc1-829c-44bd-92b8-d250b8d370fc-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:05 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:07:05 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Flow 'volume_create_manager' (ad7e8655-526c-4b5b-87ef-2a4686327964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:05 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb32f4bf-bdfd-46dd-a612-73f395469f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:06 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb32f4bf-bdfd-46dd-a612-73f395469f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-230456214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75849d28-97bb-4830-96b1-29c933d79296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4af4ab4fd1744b5835b8489e0cd7e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:06Z,use_quota=True,user_id='a98473ec4f2b4f11a910ddb1ed8b6c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:06 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e644ed7-1f0f-4816-a5fe-ec28ee254a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:06 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e644ed7-1f0f-4816-a5fe-ec28ee254a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:06 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f8bb63-88dc-4616-a6bc-f25a88282ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:06 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f8bb63-88dc-4616-a6bc-f25a88282ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75849d28-97bb-4830-96b1-29c933d79296', 'volume_name': 'volume-75849d28-97bb-4830-96b1-29c933d79296', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:06 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (582eef29-8620-4402-bf69-088774e3504b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:06 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (582eef29-8620-4402-bf69-088774e3504b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:06 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0b8afb-695a-4fed-a07e-e9d772cc5d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:06 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Volume 75849d28-97bb-4830-96b1-29c933d79296: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75849d28-97bb-4830-96b1-29c933d79296', 'volume_size': 1} Sep 04 16:07:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:06 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-230456214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75849d28-97bb-4830-96b1-29c933d79296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4af4ab4fd1744b5835b8489e0cd7e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:06Z,use_quota=True,user_id='a98473ec4f2b4f11a910ddb1ed8b6c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:07:06 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Creating volume 75849d28-97bb-4830-96b1-29c933d79296 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:07:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:06 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:06 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:06 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:07:06 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:07:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:06 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296 1073741824 Sep 04 16:07:06 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-bc863806-7601-4f66-b3fb-ef4499f70276 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "cinder-d750107e-fa5a-4b19-a774-65831a3c7dcc-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-bc863806-7601-4f66-b3fb-ef4499f70276 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "cinder-d750107e-fa5a-4b19-a774-65831a3c7dcc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:06 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296 1073741824" returned: 0 in 0.589s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-bc863806-7601-4f66-b3fb-ef4499f70276 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "cinder-quobyte-d750107e-fa5a-4b19-a774-65831a3c7dcc" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-bc863806-7601-4f66-b3fb-ef4499f70276 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "cinder-quobyte-d750107e-fa5a-4b19-a774-65831a3c7dcc" acquired by "delete_volume" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:06 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[25871e4f-ace5-4600-83f0-c5c79d49bc07]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-bc863806-7601-4f66-b3fb-ef4499f70276 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d750107e-fa5a-4b19-a774-65831a3c7dcc {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:06 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296 Sep 04 16:07:06 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:06 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d750107e-fa5a-4b19-a774-65831a3c7dcc Sep 04 16:07:06 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:07 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296" returned: 0 in 0.348s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:07 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:07:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0b8afb-695a-4fed-a07e-e9d772cc5d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75849d28-97bb-4830-96b1-29c933d79296', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a8515f9-a001-41d9-9857-80f776748cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:07 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Volume volume-75849d28-97bb-4830-96b1-29c933d79296 (75849d28-97bb-4830-96b1-29c933d79296): created successfully Sep 04 16:07:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a8515f9-a001-41d9-9857-80f776748cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Flow 'volume_create_manager' (ad7e8655-526c-4b5b-87ef-2a4686327964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:07 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-6f1726fb-8ba4-4735-8643-e69a7c04f645 tempest-VolumeDependencyTests-2130428095 None] Created volume successfully. Sep 04 16:07:07 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-bc863806-7601-4f66-b3fb-ef4499f70276 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d750107e-fa5a-4b19-a774-65831a3c7dcc" returned: 0 in 0.463s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-bc863806-7601-4f66-b3fb-ef4499f70276 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d750107e-fa5a-4b19-a774-65831a3c7dcc {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:07 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d750107e-fa5a-4b19-a774-65831a3c7dcc Sep 04 16:07:07 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:07 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-bc863806-7601-4f66-b3fb-ef4499f70276 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-d750107e-fa5a-4b19-a774-65831a3c7dcc" returned: 0 in 0.329s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-bc863806-7601-4f66-b3fb-ef4499f70276 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "cinder-quobyte-d750107e-fa5a-4b19-a774-65831a3c7dcc" released by "delete_volume" :: held 0.856s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:07 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-bc863806-7601-4f66-b3fb-ef4499f70276 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Created reservations ['a2f8ba2b-b2a4-41a3-895e-6e4f6778c856', 'af7863bd-9e0c-4bbf-ab06-04b251262c90', '8abf309a-73d7-4449-9eeb-332a5ffb1c05', '9e53a716-1750-4bf7-80ad-d9646c3967e0'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-bc863806-7601-4f66-b3fb-ef4499f70276 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-bc863806-7601-4f66-b3fb-ef4499f70276 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:07 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-bc863806-7601-4f66-b3fb-ef4499f70276 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:07 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-bc863806-7601-4f66-b3fb-ef4499f70276 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-bc863806-7601-4f66-b3fb-ef4499f70276 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-bc863806-7601-4f66-b3fb-ef4499f70276 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:07 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:07:07 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1752bea8-91ae-422d-989d-2790b94ea47d tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "cinder-adcff4af-6681-4a3c-91de-ffe290f5dbaf-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1752bea8-91ae-422d-989d-2790b94ea47d tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "cinder-adcff4af-6681-4a3c-91de-ffe290f5dbaf-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1752bea8-91ae-422d-989d-2790b94ea47d tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "cinder-quobyte-adcff4af-6681-4a3c-91de-ffe290f5dbaf" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1752bea8-91ae-422d-989d-2790b94ea47d tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "cinder-quobyte-adcff4af-6681-4a3c-91de-ffe290f5dbaf" acquired by "delete_volume" :: waited 0.016s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:07 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23e0452-ec1c-46bd-b095-9bc3114ced16]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1752bea8-91ae-422d-989d-2790b94ea47d tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-adcff4af-6681-4a3c-91de-ffe290f5dbaf {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:08 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-adcff4af-6681-4a3c-91de-ffe290f5dbaf Sep 04 16:07:08 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:08 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-bc863806-7601-4f66-b3fb-ef4499f70276 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.452s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:08 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-bc863806-7601-4f66-b3fb-ef4499f70276 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:07:08 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-bc863806-7601-4f66-b3fb-ef4499f70276 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Deleted volume successfully. Sep 04 16:07:08 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-bc863806-7601-4f66-b3fb-ef4499f70276 tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "cinder-d750107e-fa5a-4b19-a774-65831a3c7dcc-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:08 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1752bea8-91ae-422d-989d-2790b94ea47d tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-adcff4af-6681-4a3c-91de-ffe290f5dbaf" returned: 0 in 0.622s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1752bea8-91ae-422d-989d-2790b94ea47d tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-adcff4af-6681-4a3c-91de-ffe290f5dbaf {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:08 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:07:08 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-adcff4af-6681-4a3c-91de-ffe290f5dbaf Sep 04 16:07:08 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Flow 'volume_create_manager' (3a470dc5-24ab-4a39-8eb8-7d9600232f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49431843-80c6-4aa8-9092-f0a2938e194a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b46cd7b8-b934-459b-b0a4-c3c2c09e76b5 tempest-VolumeDependencyTests-2130428095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b46cd7b8-b934-459b-b0a4-c3c2c09e76b5 tempest-VolumeDependencyTests-2130428095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49431843-80c6-4aa8-9092-f0a2938e194a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2017943651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdf53a3f-771a-4825-ba63-21f237420223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='180cbaf2ee144b068a15941013944017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:09Z,use_quota=True,user_id='69651994bda64203985f0df267c9d8df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c28f399-7be4-4fcf-81fd-4d9c5d2c9c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c28f399-7be4-4fcf-81fd-4d9c5d2c9c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9065516-e62e-470d-a2a6-6326805aa083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9065516-e62e-470d-a2a6-6326805aa083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdf53a3f-771a-4825-ba63-21f237420223', 'volume_name': 'volume-cdf53a3f-771a-4825-ba63-21f237420223', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41c489ef-f451-47fd-8ab5-664144ee05f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41c489ef-f451-47fd-8ab5-664144ee05f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a168a5ab-2055-49e8-848e-5def55ee7061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:08 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Volume cdf53a3f-771a-4825-ba63-21f237420223: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdf53a3f-771a-4825-ba63-21f237420223', 'volume_size': 1} Sep 04 16:07:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:08 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-b46cd7b8-b934-459b-b0a4-c3c2c09e76b5 tempest-VolumeDependencyTests-2130428095 None] Creating offline snapshot 90964abf-45c5-411f-bb9c-dd01837fb7f5 of volume 75849d28-97bb-4830-96b1-29c933d79296 {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:07:08 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcbab71-8324-4bc4-8088-2f394918cb15]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b46cd7b8-b934-459b-b0a4-c3c2c09e76b5 tempest-VolumeDependencyTests-2130428095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:08 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296 Sep 04 16:07:08 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:08 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1752bea8-91ae-422d-989d-2790b94ea47d tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-adcff4af-6681-4a3c-91de-ffe290f5dbaf" returned: 0 in 0.294s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:08 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1752bea8-91ae-422d-989d-2790b94ea47d tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "cinder-quobyte-adcff4af-6681-4a3c-91de-ffe290f5dbaf" released by "delete_volume" :: held 0.989s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:08 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-1752bea8-91ae-422d-989d-2790b94ea47d tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Created reservations ['b7e09dd3-5083-4679-b90a-f21cb8c54672', '618657f3-b7e2-4332-b507-29ee1a919825', 'bf4b7257-cc9b-4e70-813c-2f4a195ae8c5', 'dad9db48-4efe-4e4d-bc70-4f61bea62164'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1752bea8-91ae-422d-989d-2790b94ea47d tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1752bea8-91ae-422d-989d-2790b94ea47d tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:09 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1752bea8-91ae-422d-989d-2790b94ea47d tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:09 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1752bea8-91ae-422d-989d-2790b94ea47d tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1752bea8-91ae-422d-989d-2790b94ea47d tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1752bea8-91ae-422d-989d-2790b94ea47d tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:09 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:07:09 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:09 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b46cd7b8-b934-459b-b0a4-c3c2c09e76b5 tempest-VolumeDependencyTests-2130428095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296" returned: 0 in 0.420s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b46cd7b8-b934-459b-b0a4-c3c2c09e76b5 tempest-VolumeDependencyTests-2130428095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.90964abf-45c5-411f-bb9c-dd01837fb7f5 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:09 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.90964abf-45c5-411f-bb9c-dd01837fb7f5 1G Sep 04 16:07:09 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:09 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1752bea8-91ae-422d-989d-2790b94ea47d tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.289s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:09 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-1752bea8-91ae-422d-989d-2790b94ea47d tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:07:09 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-1752bea8-91ae-422d-989d-2790b94ea47d tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Deleted volume successfully. Sep 04 16:07:09 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1752bea8-91ae-422d-989d-2790b94ea47d tempest-CreateVolumesFromSourceVolumeTest-2024925520 None] Lock "cinder-adcff4af-6681-4a3c-91de-ffe290f5dbaf-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:09 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b46cd7b8-b934-459b-b0a4-c3c2c09e76b5 tempest-VolumeDependencyTests-2130428095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.90964abf-45c5-411f-bb9c-dd01837fb7f5 1G" returned: 0 in 0.478s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b46cd7b8-b934-459b-b0a4-c3c2c09e76b5 tempest-VolumeDependencyTests-2130428095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75849d28-97bb-4830-96b1-29c933d79296 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.90964abf-45c5-411f-bb9c-dd01837fb7f5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:09 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75849d28-97bb-4830-96b1-29c933d79296 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.90964abf-45c5-411f-bb9c-dd01837fb7f5 Sep 04 16:07:09 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:09 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b46cd7b8-b934-459b-b0a4-c3c2c09e76b5 tempest-VolumeDependencyTests-2130428095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75849d28-97bb-4830-96b1-29c933d79296 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.90964abf-45c5-411f-bb9c-dd01837fb7f5" returned: 0 in 0.316s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:09 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-b46cd7b8-b934-459b-b0a4-c3c2c09e76b5 tempest-VolumeDependencyTests-2130428095 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.90964abf-45c5-411f-bb9c-dd01837fb7f5 is being set with open permissions: ugo+rw Sep 04 16:07:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b46cd7b8-b934-459b-b0a4-c3c2c09e76b5 tempest-VolumeDependencyTests-2130428095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.90964abf-45c5-411f-bb9c-dd01837fb7f5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:09 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.90964abf-45c5-411f-bb9c-dd01837fb7f5 Sep 04 16:07:09 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:10 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b46cd7b8-b934-459b-b0a4-c3c2c09e76b5 tempest-VolumeDependencyTests-2130428095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.90964abf-45c5-411f-bb9c-dd01837fb7f5" returned: 0 in 0.258s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b46cd7b8-b934-459b-b0a4-c3c2c09e76b5 tempest-VolumeDependencyTests-2130428095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:10 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.info Sep 04 16:07:10 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:07:10 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Flow 'volume_create_manager' (b682adfa-5efe-43f0-9599-c87644cec9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0597fa42-54d7-490c-aca0-3919ad10033e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b46cd7b8-b934-459b-b0a4-c3c2c09e76b5 tempest-VolumeDependencyTests-2130428095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.info" returned: 0 in 0.330s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:10 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-b46cd7b8-b934-459b-b0a4-c3c2c09e76b5 tempest-VolumeDependencyTests-2130428095 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.info is being set with open permissions: ugo+rw Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b46cd7b8-b934-459b-b0a4-c3c2c09e76b5 tempest-VolumeDependencyTests-2130428095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0597fa42-54d7-490c-aca0-3919ad10033e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cad33d7-69fe-45cc-a687-175dd8df85e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f77b5138784c91a887a53c3fd58b13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:10Z,use_quota=True,user_id='3168164700a84b6689c28abbfe79ef1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:10 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.info Sep 04 16:07:10 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0bc80fa-e7fe-43c9-b5b3-b875809db0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0bc80fa-e7fe-43c9-b5b3-b875809db0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca9f739-666e-425b-8471-c8fdbfe24acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca9f739-666e-425b-8471-c8fdbfe24acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cad33d7-69fe-45cc-a687-175dd8df85e9', 'volume_name': 'volume-6cad33d7-69fe-45cc-a687-175dd8df85e9', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a321da3-d65c-471d-9bf9-d87051aa4378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a321da3-d65c-471d-9bf9-d87051aa4378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e02b7d-d1cd-45b5-b884-b333f914db9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:10 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Volume 6cad33d7-69fe-45cc-a687-175dd8df85e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cad33d7-69fe-45cc-a687-175dd8df85e9', 'volume_size': 1} Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:10 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b46cd7b8-b934-459b-b0a4-c3c2c09e76b5 tempest-VolumeDependencyTests-2130428095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.info" returned: 0 in 0.278s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b46cd7b8-b934-459b-b0a4-c3c2c09e76b5 tempest-VolumeDependencyTests-2130428095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.240s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.191s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2017943651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdf53a3f-771a-4825-ba63-21f237420223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='180cbaf2ee144b068a15941013944017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:09Z,use_quota=True,user_id='69651994bda64203985f0df267c9d8df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Creating volume cdf53a3f-771a-4825-ba63-21f237420223 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:07:10 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:07:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cdf53a3f-771a-4825-ba63-21f237420223 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:10 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cdf53a3f-771a-4825-ba63-21f237420223 1073741824 Sep 04 16:07:10 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:10 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-b46cd7b8-b934-459b-b0a4-c3c2c09e76b5 tempest-VolumeDependencyTests-2130428095 None] Create snapshot completed successfully Sep 04 16:07:11 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cdf53a3f-771a-4825-ba63-21f237420223 1073741824" returned: 0 in 0.484s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cdf53a3f-771a-4825-ba63-21f237420223 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:11 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cdf53a3f-771a-4825-ba63-21f237420223 Sep 04 16:07:11 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:11 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cdf53a3f-771a-4825-ba63-21f237420223" returned: 0 in 0.298s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:11 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:07:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.087s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:11 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cad33d7-69fe-45cc-a687-175dd8df85e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f77b5138784c91a887a53c3fd58b13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:10Z,use_quota=True,user_id='3168164700a84b6689c28abbfe79ef1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:07:11 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Creating volume 6cad33d7-69fe-45cc-a687-175dd8df85e9 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:07:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:11 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:11 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:11 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:07:11 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:07:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6cad33d7-69fe-45cc-a687-175dd8df85e9 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:11 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a168a5ab-2055-49e8-848e-5def55ee7061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdf53a3f-771a-4825-ba63-21f237420223', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:11 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6cad33d7-69fe-45cc-a687-175dd8df85e9 1073741824 Sep 04 16:07:11 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:11 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eac0908-67d4-422b-a670-042abc16ea8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:11 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Volume volume-cdf53a3f-771a-4825-ba63-21f237420223 (cdf53a3f-771a-4825-ba63-21f237420223): created successfully Sep 04 16:07:11 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eac0908-67d4-422b-a670-042abc16ea8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:11 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Flow 'volume_create_manager' (3a470dc5-24ab-4a39-8eb8-7d9600232f7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:11 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-5de1fffa-5df2-494b-af33-07cc3a35154e tempest-ProjectReaderTests-2017246261 None] Created volume successfully. Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:07:12 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Flow 'volume_create_manager' (81a463f0-d881-42e8-8035-5e7ac2c264ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f20b1f-c7b5-4969-99ad-08d2126f2fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6cad33d7-69fe-45cc-a687-175dd8df85e9 1073741824" returned: 0 in 0.643s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f20b1f-c7b5-4969-99ad-08d2126f2fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-93936880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee74994f-67bc-4e65-a783-a5bee71af1cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4af4ab4fd1744b5835b8489e0cd7e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=90964abf-45c5-411f-bb9c-dd01837fb7f5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:12Z,use_quota=True,user_id='a98473ec4f2b4f11a910ddb1ed8b6c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f25468d-f85b-4da3-90af-310008844dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f25468d-f85b-4da3-90af-310008844dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e27ff0c-7864-4bd2-8c50-f338917a29a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e27ff0c-7864-4bd2-8c50-f338917a29a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ee74994f-67bc-4e65-a783-a5bee71af1cf', 'volume_name': 'volume-ee74994f-67bc-4e65-a783-a5bee71af1cf', 'volume_size': 1, 'snapshot_id': '90964abf-45c5-411f-bb9c-dd01837fb7f5'}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e21f1a-3c17-4a95-9357-989ab1816cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e21f1a-3c17-4a95-9357-989ab1816cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2079baa-219b-4287-839d-15e7165b3d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:12 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Volume ee74994f-67bc-4e65-a783-a5bee71af1cf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ee74994f-67bc-4e65-a783-a5bee71af1cf', 'volume_size': 1, 'snapshot_id': '90964abf-45c5-411f-bb9c-dd01837fb7f5'} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6cad33d7-69fe-45cc-a687-175dd8df85e9 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:12 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6cad33d7-69fe-45cc-a687-175dd8df85e9 Sep 04 16:07:12 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:12 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6cad33d7-69fe-45cc-a687-175dd8df85e9" returned: 0 in 0.268s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.288s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Acquiring lock "cinder-quobyte-90964abf-45c5-411f-bb9c-dd01837fb7f5-ee74994f-67bc-4e65-a783-a5bee71af1cf" by "_create_volume_from_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e02b7d-d1cd-45b5-b884-b333f914db9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cad33d7-69fe-45cc-a687-175dd8df85e9', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f17030-d943-4dff-a1c5-4efacafc2e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Lock "cinder-quobyte-90964abf-45c5-411f-bb9c-dd01837fb7f5-ee74994f-67bc-4e65-a783-a5bee71af1cf" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Creating volume ee74994f-67bc-4e65-a783-a5bee71af1cf from snapshot 90964abf-45c5-411f-bb9c-dd01837fb7f5 {{(pid=87490) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Acquiring lock "cinder-quobyte-ee74994f-67bc-4e65-a783-a5bee71af1cf" by "_copy_volume_from_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:12 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Volume volume-6cad33d7-69fe-45cc-a687-175dd8df85e9 (6cad33d7-69fe-45cc-a687-175dd8df85e9): created successfully Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f17030-d943-4dff-a1c5-4efacafc2e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Flow 'volume_create_manager' (b682adfa-5efe-43f0-9599-c87644cec9b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Lock "cinder-quobyte-ee74994f-67bc-4e65-a783-a5bee71af1cf" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] snapshot: 90964abf-45c5-411f-bb9c-dd01837fb7f5, volume: ee74994f-67bc-4e65-a783-a5bee71af1cf, {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 16:07:12 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-164456ac-0c5e-4e6e-9c72-72ffd8fdca68 tempest-CinderUnicodeTest-1859852684 None] Created volume successfully. Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[149c11c3-9f93-4429-8321-1c64757b7295]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.90964abf-45c5-411f-bb9c-dd01837fb7f5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:12 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.90964abf-45c5-411f-bb9c-dd01837fb7f5 Sep 04 16:07:12 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:13 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b717a8a6-20be-4d96-b422-f03938d5d068 tempest-ProjectReaderTests-2017246261 None] Acquiring lock "cinder-cdf53a3f-771a-4825-ba63-21f237420223-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:13 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b717a8a6-20be-4d96-b422-f03938d5d068 tempest-ProjectReaderTests-2017246261 None] Lock "cinder-cdf53a3f-771a-4825-ba63-21f237420223-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:13 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b717a8a6-20be-4d96-b422-f03938d5d068 tempest-ProjectReaderTests-2017246261 None] Acquiring lock "cinder-quobyte-cdf53a3f-771a-4825-ba63-21f237420223" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:13 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b717a8a6-20be-4d96-b422-f03938d5d068 tempest-ProjectReaderTests-2017246261 None] Lock "cinder-quobyte-cdf53a3f-771a-4825-ba63-21f237420223" acquired by "delete_volume" :: waited 0.015s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:13 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68e715b-06a2-4022-abd2-886d6cff50ef]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b717a8a6-20be-4d96-b422-f03938d5d068 tempest-ProjectReaderTests-2017246261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cdf53a3f-771a-4825-ba63-21f237420223 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:13 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:13 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cdf53a3f-771a-4825-ba63-21f237420223 Sep 04 16:07:13 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.90964abf-45c5-411f-bb9c-dd01837fb7f5" returned: 0 in 0.433s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75849d28-97bb-4830-96b1-29c933d79296(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:07:13 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34829c2-ada2-4c9d-a79a-501b4b1a3d41]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:13 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296 Sep 04 16:07:13 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:13 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b717a8a6-20be-4d96-b422-f03938d5d068 tempest-ProjectReaderTests-2017246261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cdf53a3f-771a-4825-ba63-21f237420223" returned: 0 in 0.464s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b717a8a6-20be-4d96-b422-f03938d5d068 tempest-ProjectReaderTests-2017246261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cdf53a3f-771a-4825-ba63-21f237420223 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:13 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cdf53a3f-771a-4825-ba63-21f237420223 Sep 04 16:07:13 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:13 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296" returned: 0 in 0.427s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296 {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 16:07:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Creating direct copy from snapshot {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 16:07:13 devstack cinder-volume[87490]: DEBUG cinder.utils [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Path /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ee74994f-67bc-4e65-a783-a5bee71af1cf not found in is_blk_device check {{(pid=87490) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 16:07:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ee74994f-67bc-4e65-a783-a5bee71af1cf {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:13 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ee74994f-67bc-4e65-a783-a5bee71af1cf Sep 04 16:07:13 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:13 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b717a8a6-20be-4d96-b422-f03938d5d068 tempest-ProjectReaderTests-2017246261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cdf53a3f-771a-4825-ba63-21f237420223" returned: 0 in 0.356s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b717a8a6-20be-4d96-b422-f03938d5d068 tempest-ProjectReaderTests-2017246261 None] Lock "cinder-quobyte-cdf53a3f-771a-4825-ba63-21f237420223" released by "delete_volume" :: held 0.902s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:14 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-b717a8a6-20be-4d96-b422-f03938d5d068 tempest-ProjectReaderTests-2017246261 None] Created reservations ['365bcaec-510e-4f01-bf27-874f512b5015', 'f39a1835-d2ad-4820-9abc-2b2aa231b302', 'a4d6e1ee-5249-457f-9b69-8723254fa78b', '7968a45f-35e8-44a6-8e2f-fb234d89959a'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b717a8a6-20be-4d96-b422-f03938d5d068 tempest-ProjectReaderTests-2017246261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b717a8a6-20be-4d96-b422-f03938d5d068 tempest-ProjectReaderTests-2017246261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b717a8a6-20be-4d96-b422-f03938d5d068 tempest-ProjectReaderTests-2017246261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b717a8a6-20be-4d96-b422-f03938d5d068 tempest-ProjectReaderTests-2017246261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b717a8a6-20be-4d96-b422-f03938d5d068 tempest-ProjectReaderTests-2017246261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b717a8a6-20be-4d96-b422-f03938d5d068 tempest-ProjectReaderTests-2017246261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:14 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:07:14 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:14 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b717a8a6-20be-4d96-b422-f03938d5d068 tempest-ProjectReaderTests-2017246261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.370s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:14 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-b717a8a6-20be-4d96-b422-f03938d5d068 tempest-ProjectReaderTests-2017246261 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:07:14 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-b717a8a6-20be-4d96-b422-f03938d5d068 tempest-ProjectReaderTests-2017246261 None] Deleted volume successfully. Sep 04 16:07:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b717a8a6-20be-4d96-b422-f03938d5d068 tempest-ProjectReaderTests-2017246261 None] Lock "cinder-cdf53a3f-771a-4825-ba63-21f237420223-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:14 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:07:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Flow 'volume_create_manager' (99b5fea1-ef18-424d-ae51-36f2ced89f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec67e69a-27cc-4e15-94a5-6341a308300b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec67e69a-27cc-4e15-94a5-6341a308300b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1133894917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae75d8d8-8aa2-467a-b60d-80c919c64952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67dc993fc9ce4300852a9f87ee1ded6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:14Z,use_quota=True,user_id='862f7e66540c4c5baa32a03cb34b0c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c88575-0aa2-4542-818f-a40f9338fb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c88575-0aa2-4542-818f-a40f9338fb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be17c94b-c55b-4812-824c-c7642013d9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be17c94b-c55b-4812-824c-c7642013d9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae75d8d8-8aa2-467a-b60d-80c919c64952', 'volume_name': 'volume-ae75d8d8-8aa2-467a-b60d-80c919c64952', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65e0471-32ef-4d92-9c78-4c9438ccb2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65e0471-32ef-4d92-9c78-4c9438ccb2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51c33b4-927e-4716-9b06-0b3d2e0d5471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:15 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Volume ae75d8d8-8aa2-467a-b60d-80c919c64952: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae75d8d8-8aa2-467a-b60d-80c919c64952', 'volume_size': 1} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Flow 'volume_create_manager' (df13a0df-2e22-4483-904b-583f856e5b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a0fc89d-1880-4d78-8074-89c5709cbf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a0fc89d-1880-4d78-8074-89c5709cbf7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-295217598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62515a89-1969-4b3e-9865-2c8ae0c48c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f77b5138784c91a887a53c3fd58b13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:15Z,use_quota=True,user_id='3168164700a84b6689c28abbfe79ef1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b081bb63-e652-42cf-b27a-08a4ca94c500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b081bb63-e652-42cf-b27a-08a4ca94c500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0789d90d-23bc-4c0a-aa40-732ad58ab0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0789d90d-23bc-4c0a-aa40-732ad58ab0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62515a89-1969-4b3e-9865-2c8ae0c48c6a', 'volume_name': 'volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec4c436b-0655-4a8a-846a-831c1b80a0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec4c436b-0655-4a8a-846a-831c1b80a0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372df602-ad22-4699-bbcd-57202f2f8a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:15 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Volume 62515a89-1969-4b3e-9865-2c8ae0c48c6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a', 'volume_size': 1} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Flow 'volume_create_manager' (64d9dd19-138a-4db0-aaac-531cafc09732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58323215-d3fe-41ff-a6d5-f8253eb3b0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58323215-d3fe-41ff-a6d5-f8253eb3b0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-771427076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0318a18f-b5c8-4aa5-972a-46d0caa851b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='180cbaf2ee144b068a15941013944017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:15Z,use_quota=True,user_id='69651994bda64203985f0df267c9d8df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e246569d-d312-455d-ad02-127b597647b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e246569d-d312-455d-ad02-127b597647b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95250a3b-aacc-4408-8ce6-9a717e06575e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95250a3b-aacc-4408-8ce6-9a717e06575e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0318a18f-b5c8-4aa5-972a-46d0caa851b1', 'volume_name': 'volume-0318a18f-b5c8-4aa5-972a-46d0caa851b1', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c62019-28df-462c-9172-afd77f5f4818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c62019-28df-462c-9172-afd77f5f4818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a610a932-d48d-42f9-85d3-21a0bd71f089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:15 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Volume 0318a18f-b5c8-4aa5-972a-46d0caa851b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0318a18f-b5c8-4aa5-972a-46d0caa851b1', 'volume_size': 1} Sep 04 16:07:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:18 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ee74994f-67bc-4e65-a783-a5bee71af1cf" returned: 0 in 4.693s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:18 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296, size 1024.00 MB, duration 4.69 sec, destination /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ee74994f-67bc-4e65-a783-a5bee71af1cf {{(pid=87490) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 16:07:18 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Converted 1024.00 MB image at 218.16 MB/s Sep 04 16:07:18 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ee74994f-67bc-4e65-a783-a5bee71af1cf is being set with open permissions: ugo+rw Sep 04 16:07:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ee74994f-67bc-4e65-a783-a5bee71af1cf {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:18 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ee74994f-67bc-4e65-a783-a5bee71af1cf Sep 04 16:07:18 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:18 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ee74994f-67bc-4e65-a783-a5bee71af1cf" returned: 0 in 0.229s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:18 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Lock "cinder-quobyte-ee74994f-67bc-4e65-a783-a5bee71af1cf" released by "_copy_volume_from_snapshot" :: held 5.881s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:18 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Lock "cinder-quobyte-90964abf-45c5-411f-bb9c-dd01837fb7f5-ee74994f-67bc-4e65-a783-a5bee71af1cf" released by "_create_volume_from_snapshot" :: held 5.957s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.987s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.589s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1133894917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae75d8d8-8aa2-467a-b60d-80c919c64952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67dc993fc9ce4300852a9f87ee1ded6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:14Z,use_quota=True,user_id='862f7e66540c4c5baa32a03cb34b0c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:07:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Creating volume ae75d8d8-8aa2-467a-b60d-80c919c64952 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:07:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:07:18 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:07:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:18 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952 1073741824 Sep 04 16:07:18 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2079baa-219b-4287-839d-15e7165b3d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee74994f-67bc-4e65-a783-a5bee71af1cf', 'volume_size': 1, 'snapshot_id': '90964abf-45c5-411f-bb9c-dd01837fb7f5'}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a3b684-b8fb-4fe1-a618-98056b70fd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:18 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Volume volume-ee74994f-67bc-4e65-a783-a5bee71af1cf (ee74994f-67bc-4e65-a783-a5bee71af1cf): created successfully Sep 04 16:07:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a3b684-b8fb-4fe1-a618-98056b70fd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:18 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Flow 'volume_create_manager' (81a463f0-d881-42e8-8035-5e7ac2c264ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:18 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-344a0496-767f-4e7f-b3f7-3d7621ab4b66 tempest-VolumeDependencyTests-2130428095 None] Created volume successfully. Sep 04 16:07:19 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952 1073741824" returned: 0 in 0.401s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:19 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952 Sep 04 16:07:19 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:19 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952" returned: 0 in 0.243s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:07:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.935s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-295217598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62515a89-1969-4b3e-9865-2c8ae0c48c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f77b5138784c91a887a53c3fd58b13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:15Z,use_quota=True,user_id='3168164700a84b6689c28abbfe79ef1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:07:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Creating volume 62515a89-1969-4b3e-9865-2c8ae0c48c6a {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:07:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:07:19 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:07:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51c33b4-927e-4716-9b06-0b3d2e0d5471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae75d8d8-8aa2-467a-b60d-80c919c64952', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:19 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a 1073741824 Sep 04 16:07:19 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc7b8ca-663d-4702-80c4-79ce11b23769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:19 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Volume volume-ae75d8d8-8aa2-467a-b60d-80c919c64952 (ae75d8d8-8aa2-467a-b60d-80c919c64952): created successfully Sep 04 16:07:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc7b8ca-663d-4702-80c4-79ce11b23769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Flow 'volume_create_manager' (99b5fea1-ef18-424d-ae51-36f2ced89f40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:19 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-642ae9ac-3b80-4940-8a50-dfc2a169007b tempest-ProjectMemberTests-322461420 None] Created volume successfully. Sep 04 16:07:19 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a 1073741824" returned: 0 in 0.471s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3695567a-747c-4cd0-be70-40481e405a99 tempest-VolumeDependencyTests-2130428095 None] Acquiring lock "cinder-90964abf-45c5-411f-bb9c-dd01837fb7f5-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3695567a-747c-4cd0-be70-40481e405a99 tempest-VolumeDependencyTests-2130428095 None] Lock "cinder-90964abf-45c5-411f-bb9c-dd01837fb7f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3695567a-747c-4cd0-be70-40481e405a99 tempest-VolumeDependencyTests-2130428095 None] Acquiring lock "cinder-quobyte-75849d28-97bb-4830-96b1-29c933d79296" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3695567a-747c-4cd0-be70-40481e405a99 tempest-VolumeDependencyTests-2130428095 None] Lock "cinder-quobyte-75849d28-97bb-4830-96b1-29c933d79296" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3695567a-747c-4cd0-be70-40481e405a99 tempest-VolumeDependencyTests-2130428095 None] Acquiring lock "cinder-quobyte-90964abf-45c5-411f-bb9c-dd01837fb7f5" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:19 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a Sep 04 16:07:19 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3695567a-747c-4cd0-be70-40481e405a99 tempest-VolumeDependencyTests-2130428095 None] Lock "cinder-quobyte-90964abf-45c5-411f-bb9c-dd01837fb7f5" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-3695567a-747c-4cd0-be70-40481e405a99 tempest-VolumeDependencyTests-2130428095 None] Deleting offline snapshot 90964abf-45c5-411f-bb9c-dd01837fb7f5 of volume 75849d28-97bb-4830-96b1-29c933d79296 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-3695567a-747c-4cd0-be70-40481e405a99 tempest-VolumeDependencyTests-2130428095 None] snapshot_file for this snap is: volume-75849d28-97bb-4830-96b1-29c933d79296.90964abf-45c5-411f-bb9c-dd01837fb7f5 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da9e511-72cc-4905-8222-af4c11983322]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3695567a-747c-4cd0-be70-40481e405a99 tempest-VolumeDependencyTests-2130428095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.90964abf-45c5-411f-bb9c-dd01837fb7f5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5b6f8fb1-5965-4cad-bcb8-6fb81da2a6eb tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:20 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.90964abf-45c5-411f-bb9c-dd01837fb7f5 Sep 04 16:07:20 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:20 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a" returned: 0 in 0.287s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.539s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-771427076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0318a18f-b5c8-4aa5-972a-46d0caa851b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='180cbaf2ee144b068a15941013944017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:15Z,use_quota=True,user_id='69651994bda64203985f0df267c9d8df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Creating volume 0318a18f-b5c8-4aa5-972a-46d0caa851b1 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:07:20 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0318a18f-b5c8-4aa5-972a-46d0caa851b1 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372df602-ad22-4699-bbcd-57202f2f8a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:20 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0318a18f-b5c8-4aa5-972a-46d0caa851b1 1073741824 Sep 04 16:07:20 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0ff8ad-199c-4ae8-ba20-fe65431b79d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:20 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Volume volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a (62515a89-1969-4b3e-9865-2c8ae0c48c6a): created successfully Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0ff8ad-199c-4ae8-ba20-fe65431b79d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Flow 'volume_create_manager' (df13a0df-2e22-4483-904b-583f856e5b00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:20 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-1fcca34e-4620-4005-ab04-7a7f3f39e796 tempest-CinderUnicodeTest-1859852684 None] Created volume successfully. Sep 04 16:07:20 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3695567a-747c-4cd0-be70-40481e405a99 tempest-VolumeDependencyTests-2130428095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.90964abf-45c5-411f-bb9c-dd01837fb7f5" returned: 0 in 0.398s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-3695567a-747c-4cd0-be70-40481e405a99 tempest-VolumeDependencyTests-2130428095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75849d28-97bb-4830-96b1-29c933d79296(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa468ec3-5818-44c1-90fd-baf8b2cac2c3]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3695567a-747c-4cd0-be70-40481e405a99 tempest-VolumeDependencyTests-2130428095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:20 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296 Sep 04 16:07:20 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:20 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0318a18f-b5c8-4aa5-972a-46d0caa851b1 1073741824" returned: 0 in 0.427s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0318a18f-b5c8-4aa5-972a-46d0caa851b1 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:20 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0318a18f-b5c8-4aa5-972a-46d0caa851b1 Sep 04 16:07:20 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:21 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:21 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3695567a-747c-4cd0-be70-40481e405a99 tempest-VolumeDependencyTests-2130428095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296" returned: 0 in 0.578s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0318a18f-b5c8-4aa5-972a-46d0caa851b1" returned: 0 in 0.325s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3695567a-747c-4cd0-be70-40481e405a99 tempest-VolumeDependencyTests-2130428095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.90964abf-45c5-411f-bb9c-dd01837fb7f5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5b6f8fb1-5965-4cad-bcb8-6fb81da2a6eb tempest-ProjectMemberTests-322461420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.921s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:21 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.90964abf-45c5-411f-bb9c-dd01837fb7f5 Sep 04 16:07:21 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a610a932-d48d-42f9-85d3-21a0bd71f089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0318a18f-b5c8-4aa5-972a-46d0caa851b1', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f1d980-9f16-4744-afb0-d6a1eeb820b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-5b6f8fb1-5965-4cad-bcb8-6fb81da2a6eb tempest-ProjectMemberTests-322461420 None] Creating offline snapshot ff9f1367-1314-4ef3-869a-f93d26a83788 of volume ae75d8d8-8aa2-467a-b60d-80c919c64952 {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:07:21 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Volume volume-0318a18f-b5c8-4aa5-972a-46d0caa851b1 (0318a18f-b5c8-4aa5-972a-46d0caa851b1): created successfully Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f1d980-9f16-4744-afb0-d6a1eeb820b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Flow 'volume_create_manager' (64d9dd19-138a-4db0-aaac-531cafc09732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[38042342-28e7-480d-ba0f-2ada6e242ee4]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5b6f8fb1-5965-4cad-bcb8-6fb81da2a6eb tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:21 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-b851bfa6-e894-423f-be53-20af9cf7fc80 tempest-ProjectReaderTests-2017246261 None] Created volume successfully. Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3765a027-0b4b-40a1-bc45-5b90fb92fae0 tempest-CinderUnicodeTest-1859852684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:21 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952 Sep 04 16:07:21 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:21 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3695567a-747c-4cd0-be70-40481e405a99 tempest-VolumeDependencyTests-2130428095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.90964abf-45c5-411f-bb9c-dd01837fb7f5" returned: 0 in 0.355s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3695567a-747c-4cd0-be70-40481e405a99 tempest-VolumeDependencyTests-2130428095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.90964abf-45c5-411f-bb9c-dd01837fb7f5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:21 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.90964abf-45c5-411f-bb9c-dd01837fb7f5 Sep 04 16:07:21 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5b6f8fb1-5965-4cad-bcb8-6fb81da2a6eb tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952" returned: 0 in 0.442s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5b6f8fb1-5965-4cad-bcb8-6fb81da2a6eb tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952.ff9f1367-1314-4ef3-869a-f93d26a83788 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:21 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:21 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952.ff9f1367-1314-4ef3-869a-f93d26a83788 1G Sep 04 16:07:21 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-301d5806-da8e-4cfe-9c15-c016fa7ec0ff tempest-ProjectReaderTests-2017246261 None] Acquiring lock "cinder-0318a18f-b5c8-4aa5-972a-46d0caa851b1-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:21 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3695567a-747c-4cd0-be70-40481e405a99 tempest-VolumeDependencyTests-2130428095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296.90964abf-45c5-411f-bb9c-dd01837fb7f5" returned: 0 in 0.266s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-301d5806-da8e-4cfe-9c15-c016fa7ec0ff tempest-ProjectReaderTests-2017246261 None] Lock "cinder-0318a18f-b5c8-4aa5-972a-46d0caa851b1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3695567a-747c-4cd0-be70-40481e405a99 tempest-VolumeDependencyTests-2130428095 None] Lock "cinder-quobyte-90964abf-45c5-411f-bb9c-dd01837fb7f5" released by "_delete_snapshot" :: held 1.723s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3695567a-747c-4cd0-be70-40481e405a99 tempest-VolumeDependencyTests-2130428095 None] Lock "cinder-quobyte-75849d28-97bb-4830-96b1-29c933d79296" released by "delete_snapshot" :: held 1.760s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-301d5806-da8e-4cfe-9c15-c016fa7ec0ff tempest-ProjectReaderTests-2017246261 None] Acquiring lock "cinder-quobyte-0318a18f-b5c8-4aa5-972a-46d0caa851b1" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-301d5806-da8e-4cfe-9c15-c016fa7ec0ff tempest-ProjectReaderTests-2017246261 None] Lock "cinder-quobyte-0318a18f-b5c8-4aa5-972a-46d0caa851b1" acquired by "delete_volume" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[c640a1de-313e-49c1-806d-0233ecb226b9]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-301d5806-da8e-4cfe-9c15-c016fa7ec0ff tempest-ProjectReaderTests-2017246261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0318a18f-b5c8-4aa5-972a-46d0caa851b1 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-3695567a-747c-4cd0-be70-40481e405a99 tempest-VolumeDependencyTests-2130428095 None] Created reservations ['38e23d94-156d-4e50-9b75-640e01ffbb64', '057965a4-5da2-44f8-b70c-82c7a69a7d98', '05d12366-9738-44d1-a82f-160569f1e1de', '18f0ca5a-ccc2-45ea-81fa-019d07ff260c'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:21 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-3695567a-747c-4cd0-be70-40481e405a99 tempest-VolumeDependencyTests-2130428095 None] Delete snapshot completed successfully. Sep 04 16:07:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3695567a-747c-4cd0-be70-40481e405a99 tempest-VolumeDependencyTests-2130428095 None] Lock "cinder-90964abf-45c5-411f-bb9c-dd01837fb7f5-delete_snapshot" released by "delete_snapshot" :: held 2.020s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:21 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0318a18f-b5c8-4aa5-972a-46d0caa851b1 Sep 04 16:07:21 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-19e752cb-58e9-4ad9-932f-929fc23c63f6 tempest-VolumeDependencyTests-2130428095 None] Acquiring lock "cinder-75849d28-97bb-4830-96b1-29c933d79296-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-19e752cb-58e9-4ad9-932f-929fc23c63f6 tempest-VolumeDependencyTests-2130428095 None] Lock "cinder-75849d28-97bb-4830-96b1-29c933d79296-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:22 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5b6f8fb1-5965-4cad-bcb8-6fb81da2a6eb tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952.ff9f1367-1314-4ef3-869a-f93d26a83788 1G" returned: 0 in 0.559s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5b6f8fb1-5965-4cad-bcb8-6fb81da2a6eb tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae75d8d8-8aa2-467a-b60d-80c919c64952 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952.ff9f1367-1314-4ef3-869a-f93d26a83788 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:22 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae75d8d8-8aa2-467a-b60d-80c919c64952 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952.ff9f1367-1314-4ef3-869a-f93d26a83788 Sep 04 16:07:22 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-19e752cb-58e9-4ad9-932f-929fc23c63f6 tempest-VolumeDependencyTests-2130428095 None] Acquiring lock "cinder-quobyte-75849d28-97bb-4830-96b1-29c933d79296" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-19e752cb-58e9-4ad9-932f-929fc23c63f6 tempest-VolumeDependencyTests-2130428095 None] Lock "cinder-quobyte-75849d28-97bb-4830-96b1-29c933d79296" acquired by "delete_volume" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:22 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[5360b39d-9bfa-499f-853c-68491d92adb9]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-19e752cb-58e9-4ad9-932f-929fc23c63f6 tempest-VolumeDependencyTests-2130428095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:22 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-301d5806-da8e-4cfe-9c15-c016fa7ec0ff tempest-ProjectReaderTests-2017246261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0318a18f-b5c8-4aa5-972a-46d0caa851b1" returned: 0 in 0.480s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-301d5806-da8e-4cfe-9c15-c016fa7ec0ff tempest-ProjectReaderTests-2017246261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0318a18f-b5c8-4aa5-972a-46d0caa851b1 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:22 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0318a18f-b5c8-4aa5-972a-46d0caa851b1 Sep 04 16:07:22 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:22 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296 Sep 04 16:07:22 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:22 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5b6f8fb1-5965-4cad-bcb8-6fb81da2a6eb tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae75d8d8-8aa2-467a-b60d-80c919c64952 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952.ff9f1367-1314-4ef3-869a-f93d26a83788" returned: 0 in 0.319s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:22 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-5b6f8fb1-5965-4cad-bcb8-6fb81da2a6eb tempest-ProjectMemberTests-322461420 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952.ff9f1367-1314-4ef3-869a-f93d26a83788 is being set with open permissions: ugo+rw Sep 04 16:07:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5b6f8fb1-5965-4cad-bcb8-6fb81da2a6eb tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952.ff9f1367-1314-4ef3-869a-f93d26a83788 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:22 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952.ff9f1367-1314-4ef3-869a-f93d26a83788 Sep 04 16:07:22 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:22 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-301d5806-da8e-4cfe-9c15-c016fa7ec0ff tempest-ProjectReaderTests-2017246261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-0318a18f-b5c8-4aa5-972a-46d0caa851b1" returned: 0 in 0.261s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-301d5806-da8e-4cfe-9c15-c016fa7ec0ff tempest-ProjectReaderTests-2017246261 None] Lock "cinder-quobyte-0318a18f-b5c8-4aa5-972a-46d0caa851b1" released by "delete_volume" :: held 0.790s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:22 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-301d5806-da8e-4cfe-9c15-c016fa7ec0ff tempest-ProjectReaderTests-2017246261 None] Created reservations ['1a066c01-efcc-4426-800e-3da5d83da7ef', 'db515acc-697c-4a2f-a5b3-3949291d9c3c', 'c8a99df3-6e6b-45db-83fa-4438a3236461', 'd4210743-272f-403a-9b47-2b4bf7d39ba8'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:22 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-19e752cb-58e9-4ad9-932f-929fc23c63f6 tempest-VolumeDependencyTests-2130428095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296" returned: 0 in 0.380s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-19e752cb-58e9-4ad9-932f-929fc23c63f6 tempest-VolumeDependencyTests-2130428095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:22 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296 Sep 04 16:07:22 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-301d5806-da8e-4cfe-9c15-c016fa7ec0ff tempest-ProjectReaderTests-2017246261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-301d5806-da8e-4cfe-9c15-c016fa7ec0ff tempest-ProjectReaderTests-2017246261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-301d5806-da8e-4cfe-9c15-c016fa7ec0ff tempest-ProjectReaderTests-2017246261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-301d5806-da8e-4cfe-9c15-c016fa7ec0ff tempest-ProjectReaderTests-2017246261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-301d5806-da8e-4cfe-9c15-c016fa7ec0ff tempest-ProjectReaderTests-2017246261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-301d5806-da8e-4cfe-9c15-c016fa7ec0ff tempest-ProjectReaderTests-2017246261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:22 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:07:22 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:22 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5b6f8fb1-5965-4cad-bcb8-6fb81da2a6eb tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952.ff9f1367-1314-4ef3-869a-f93d26a83788" returned: 0 in 0.279s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5b6f8fb1-5965-4cad-bcb8-6fb81da2a6eb tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:22 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952.info Sep 04 16:07:22 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:22 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-19e752cb-58e9-4ad9-932f-929fc23c63f6 tempest-VolumeDependencyTests-2130428095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-75849d28-97bb-4830-96b1-29c933d79296" returned: 0 in 0.280s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-19e752cb-58e9-4ad9-932f-929fc23c63f6 tempest-VolumeDependencyTests-2130428095 None] Lock "cinder-quobyte-75849d28-97bb-4830-96b1-29c933d79296" released by "delete_volume" :: held 0.727s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:23 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-301d5806-da8e-4cfe-9c15-c016fa7ec0ff tempest-ProjectReaderTests-2017246261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.298s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-301d5806-da8e-4cfe-9c15-c016fa7ec0ff tempest-ProjectReaderTests-2017246261 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:07:23 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-301d5806-da8e-4cfe-9c15-c016fa7ec0ff tempest-ProjectReaderTests-2017246261 None] Deleted volume successfully. Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-19e752cb-58e9-4ad9-932f-929fc23c63f6 tempest-VolumeDependencyTests-2130428095 None] Created reservations ['87a5a391-05a8-4f49-8438-4d4e5ec8716e', 'cd34a694-838c-4964-b620-c52f01ea810e', '74809128-8dd6-4d44-b7b1-dc15b15f246f', '66b4da97-de87-4280-aa5d-ee642f6eab44'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-301d5806-da8e-4cfe-9c15-c016fa7ec0ff tempest-ProjectReaderTests-2017246261 None] Lock "cinder-0318a18f-b5c8-4aa5-972a-46d0caa851b1-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:23 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5b6f8fb1-5965-4cad-bcb8-6fb81da2a6eb tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952.info" returned: 0 in 0.282s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:23 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-5b6f8fb1-5965-4cad-bcb8-6fb81da2a6eb tempest-ProjectMemberTests-322461420 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952.info is being set with open permissions: ugo+rw Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5b6f8fb1-5965-4cad-bcb8-6fb81da2a6eb tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:23 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952.info Sep 04 16:07:23 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-19e752cb-58e9-4ad9-932f-929fc23c63f6 tempest-VolumeDependencyTests-2130428095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-19e752cb-58e9-4ad9-932f-929fc23c63f6 tempest-VolumeDependencyTests-2130428095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-19e752cb-58e9-4ad9-932f-929fc23c63f6 tempest-VolumeDependencyTests-2130428095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-19e752cb-58e9-4ad9-932f-929fc23c63f6 tempest-VolumeDependencyTests-2130428095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-19e752cb-58e9-4ad9-932f-929fc23c63f6 tempest-VolumeDependencyTests-2130428095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-19e752cb-58e9-4ad9-932f-929fc23c63f6 tempest-VolumeDependencyTests-2130428095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:23 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:07:23 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0d28ca5d-e384-499f-b610-ca30825544b2 tempest-VolumeDependencyTests-2130428095 None] Acquiring lock "cinder-ee74994f-67bc-4e65-a783-a5bee71af1cf-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0d28ca5d-e384-499f-b610-ca30825544b2 tempest-VolumeDependencyTests-2130428095 None] Lock "cinder-ee74994f-67bc-4e65-a783-a5bee71af1cf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:23 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0d28ca5d-e384-499f-b610-ca30825544b2 tempest-VolumeDependencyTests-2130428095 None] Acquiring lock "cinder-quobyte-ee74994f-67bc-4e65-a783-a5bee71af1cf" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5b6f8fb1-5965-4cad-bcb8-6fb81da2a6eb tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952.info" returned: 0 in 0.339s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:23 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5b6f8fb1-5965-4cad-bcb8-6fb81da2a6eb tempest-ProjectMemberTests-322461420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.386s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3765a027-0b4b-40a1-bc45-5b90fb92fae0 tempest-CinderUnicodeTest-1859852684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.249s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Flow 'volume_create_manager' (aa8ef937-6b9c-4d32-b0dc-66cb5f2d314a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5fe93d-0a8f-459a-8987-91d7d13279b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0d28ca5d-e384-499f-b610-ca30825544b2 tempest-VolumeDependencyTests-2130428095 None] Lock "cinder-quobyte-ee74994f-67bc-4e65-a783-a5bee71af1cf" acquired by "delete_volume" :: waited 0.067s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-19e752cb-58e9-4ad9-932f-929fc23c63f6 tempest-VolumeDependencyTests-2130428095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.362s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-19e752cb-58e9-4ad9-932f-929fc23c63f6 tempest-VolumeDependencyTests-2130428095 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[3839a89d-185c-451d-849f-fcb70f04b989]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0d28ca5d-e384-499f-b610-ca30825544b2 tempest-VolumeDependencyTests-2130428095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ee74994f-67bc-4e65-a783-a5bee71af1cf {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:23 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-19e752cb-58e9-4ad9-932f-929fc23c63f6 tempest-VolumeDependencyTests-2130428095 None] Deleted volume successfully. Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-3765a027-0b4b-40a1-bc45-5b90fb92fae0 tempest-CinderUnicodeTest-1859852684 None] Creating offline snapshot 770a72a5-7452-4c7d-aaf3-25ada69f9128 of volume 62515a89-1969-4b3e-9865-2c8ae0c48c6a {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5fe93d-0a8f-459a-8987-91d7d13279b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-864964267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f643602-d476-44be-9f5a-5b24868da656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='180cbaf2ee144b068a15941013944017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:23Z,use_quota=True,user_id='69651994bda64203985f0df267c9d8df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399294e0-cf6c-4a64-a7fa-cc0e3d9869cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399294e0-cf6c-4a64-a7fa-cc0e3d9869cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faaee377-c887-4804-9570-e87873b4eff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faaee377-c887-4804-9570-e87873b4eff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f643602-d476-44be-9f5a-5b24868da656', 'volume_name': 'volume-7f643602-d476-44be-9f5a-5b24868da656', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c1a33c-3906-4ed3-a5dc-85785cb0d9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:23 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ee74994f-67bc-4e65-a783-a5bee71af1cf Sep 04 16:07:23 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c1a33c-3906-4ed3-a5dc-85785cb0d9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b6a2cd-4a44-406e-abd8-54ac3731b5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:23 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Volume 7f643602-d476-44be-9f5a-5b24868da656: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f643602-d476-44be-9f5a-5b24868da656', 'volume_size': 1} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c8c5e1-3243-4041-958f-a8d37dccd302]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3765a027-0b4b-40a1-bc45-5b90fb92fae0 tempest-CinderUnicodeTest-1859852684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:23 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-5b6f8fb1-5965-4cad-bcb8-6fb81da2a6eb tempest-ProjectMemberTests-322461420 None] Create snapshot completed successfully Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-19e752cb-58e9-4ad9-932f-929fc23c63f6 tempest-VolumeDependencyTests-2130428095 None] Lock "cinder-75849d28-97bb-4830-96b1-29c933d79296-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:23 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a Sep 04 16:07:23 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:23 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0d28ca5d-e384-499f-b610-ca30825544b2 tempest-VolumeDependencyTests-2130428095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ee74994f-67bc-4e65-a783-a5bee71af1cf" returned: 0 in 0.341s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0d28ca5d-e384-499f-b610-ca30825544b2 tempest-VolumeDependencyTests-2130428095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ee74994f-67bc-4e65-a783-a5bee71af1cf {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:23 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ee74994f-67bc-4e65-a783-a5bee71af1cf Sep 04 16:07:23 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:24 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3765a027-0b4b-40a1-bc45-5b90fb92fae0 tempest-CinderUnicodeTest-1859852684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a" returned: 0 in 0.382s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3765a027-0b4b-40a1-bc45-5b90fb92fae0 tempest-CinderUnicodeTest-1859852684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a.770a72a5-7452-4c7d-aaf3-25ada69f9128 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:24 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a.770a72a5-7452-4c7d-aaf3-25ada69f9128 1G Sep 04 16:07:24 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:24 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0d28ca5d-e384-499f-b610-ca30825544b2 tempest-VolumeDependencyTests-2130428095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ee74994f-67bc-4e65-a783-a5bee71af1cf" returned: 0 in 0.241s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0d28ca5d-e384-499f-b610-ca30825544b2 tempest-VolumeDependencyTests-2130428095 None] Lock "cinder-quobyte-ee74994f-67bc-4e65-a783-a5bee71af1cf" released by "delete_volume" :: held 0.628s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-0d28ca5d-e384-499f-b610-ca30825544b2 tempest-VolumeDependencyTests-2130428095 None] Created reservations ['cb2f2578-dc0a-4907-b4f7-9fb830ee38d0', '83b3e167-6f5c-401d-bbcf-1ae2b7e0bc49', 'b8dd0f01-ea34-4503-b180-123bae626bbe', 'ce52e658-f06a-4781-a9c5-71cfd9d94f9d'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0d28ca5d-e384-499f-b610-ca30825544b2 tempest-VolumeDependencyTests-2130428095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0d28ca5d-e384-499f-b610-ca30825544b2 tempest-VolumeDependencyTests-2130428095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-0d28ca5d-e384-499f-b610-ca30825544b2 tempest-VolumeDependencyTests-2130428095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-0d28ca5d-e384-499f-b610-ca30825544b2 tempest-VolumeDependencyTests-2130428095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-0d28ca5d-e384-499f-b610-ca30825544b2 tempest-VolumeDependencyTests-2130428095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0d28ca5d-e384-499f-b610-ca30825544b2 tempest-VolumeDependencyTests-2130428095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:24 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:07:24 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-29af6456-36f1-48b6-bd40-335ed626eeec tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-ff9f1367-1314-4ef3-869a-f93d26a83788-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-29af6456-36f1-48b6-bd40-335ed626eeec tempest-ProjectMemberTests-322461420 None] Lock "cinder-ff9f1367-1314-4ef3-869a-f93d26a83788-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-29af6456-36f1-48b6-bd40-335ed626eeec tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-quobyte-ae75d8d8-8aa2-467a-b60d-80c919c64952" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-29af6456-36f1-48b6-bd40-335ed626eeec tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-ae75d8d8-8aa2-467a-b60d-80c919c64952" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-29af6456-36f1-48b6-bd40-335ed626eeec tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-quobyte-ff9f1367-1314-4ef3-869a-f93d26a83788" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-29af6456-36f1-48b6-bd40-335ed626eeec tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-ff9f1367-1314-4ef3-869a-f93d26a83788" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-29af6456-36f1-48b6-bd40-335ed626eeec tempest-ProjectMemberTests-322461420 None] Deleting offline snapshot ff9f1367-1314-4ef3-869a-f93d26a83788 of volume ae75d8d8-8aa2-467a-b60d-80c919c64952 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-29af6456-36f1-48b6-bd40-335ed626eeec tempest-ProjectMemberTests-322461420 None] snapshot_file for this snap is: volume-ae75d8d8-8aa2-467a-b60d-80c919c64952.ff9f1367-1314-4ef3-869a-f93d26a83788 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae9ef7c-7fc7-46de-a36f-8f35d16c7999]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-29af6456-36f1-48b6-bd40-335ed626eeec tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952.ff9f1367-1314-4ef3-869a-f93d26a83788 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:24 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3765a027-0b4b-40a1-bc45-5b90fb92fae0 tempest-CinderUnicodeTest-1859852684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a.770a72a5-7452-4c7d-aaf3-25ada69f9128 1G" returned: 0 in 0.481s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3765a027-0b4b-40a1-bc45-5b90fb92fae0 tempest-CinderUnicodeTest-1859852684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a.770a72a5-7452-4c7d-aaf3-25ada69f9128 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:24 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-0d28ca5d-e384-499f-b610-ca30825544b2 tempest-VolumeDependencyTests-2130428095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.296s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-0d28ca5d-e384-499f-b610-ca30825544b2 tempest-VolumeDependencyTests-2130428095 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:07:24 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-0d28ca5d-e384-499f-b610-ca30825544b2 tempest-VolumeDependencyTests-2130428095 None] Deleted volume successfully. Sep 04 16:07:24 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a.770a72a5-7452-4c7d-aaf3-25ada69f9128 Sep 04 16:07:24 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-0d28ca5d-e384-499f-b610-ca30825544b2 tempest-VolumeDependencyTests-2130428095 None] Lock "cinder-ee74994f-67bc-4e65-a783-a5bee71af1cf-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:24 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952.ff9f1367-1314-4ef3-869a-f93d26a83788 Sep 04 16:07:24 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:24 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3765a027-0b4b-40a1-bc45-5b90fb92fae0 tempest-CinderUnicodeTest-1859852684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a.770a72a5-7452-4c7d-aaf3-25ada69f9128" returned: 0 in 0.305s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:24 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-3765a027-0b4b-40a1-bc45-5b90fb92fae0 tempest-CinderUnicodeTest-1859852684 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a.770a72a5-7452-4c7d-aaf3-25ada69f9128 is being set with open permissions: ugo+rw Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3765a027-0b4b-40a1-bc45-5b90fb92fae0 tempest-CinderUnicodeTest-1859852684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a.770a72a5-7452-4c7d-aaf3-25ada69f9128 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:24 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a.770a72a5-7452-4c7d-aaf3-25ada69f9128 Sep 04 16:07:24 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:24 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-29af6456-36f1-48b6-bd40-335ed626eeec tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952.ff9f1367-1314-4ef3-869a-f93d26a83788" returned: 0 in 0.418s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-29af6456-36f1-48b6-bd40-335ed626eeec tempest-ProjectMemberTests-322461420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae75d8d8-8aa2-467a-b60d-80c919c64952(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8c9496-49ac-4e5b-9bd9-39741521f085]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-29af6456-36f1-48b6-bd40-335ed626eeec tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:25 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952 Sep 04 16:07:25 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:25 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3765a027-0b4b-40a1-bc45-5b90fb92fae0 tempest-CinderUnicodeTest-1859852684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a.770a72a5-7452-4c7d-aaf3-25ada69f9128" returned: 0 in 0.266s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3765a027-0b4b-40a1-bc45-5b90fb92fae0 tempest-CinderUnicodeTest-1859852684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:25 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a.info Sep 04 16:07:25 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:25 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-29af6456-36f1-48b6-bd40-335ed626eeec tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952" returned: 0 in 0.419s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-29af6456-36f1-48b6-bd40-335ed626eeec tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952.ff9f1367-1314-4ef3-869a-f93d26a83788 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:25 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952.ff9f1367-1314-4ef3-869a-f93d26a83788 Sep 04 16:07:25 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:25 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3765a027-0b4b-40a1-bc45-5b90fb92fae0 tempest-CinderUnicodeTest-1859852684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a.info" returned: 0 in 0.293s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:25 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-3765a027-0b4b-40a1-bc45-5b90fb92fae0 tempest-CinderUnicodeTest-1859852684 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a.info is being set with open permissions: ugo+rw Sep 04 16:07:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3765a027-0b4b-40a1-bc45-5b90fb92fae0 tempest-CinderUnicodeTest-1859852684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:25 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a.info Sep 04 16:07:25 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:25 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3765a027-0b4b-40a1-bc45-5b90fb92fae0 tempest-CinderUnicodeTest-1859852684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a.info" returned: 0 in 0.278s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3765a027-0b4b-40a1-bc45-5b90fb92fae0 tempest-CinderUnicodeTest-1859852684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.257s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.082s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-864964267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f643602-d476-44be-9f5a-5b24868da656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='180cbaf2ee144b068a15941013944017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:23Z,use_quota=True,user_id='69651994bda64203985f0df267c9d8df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:07:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Creating volume 7f643602-d476-44be-9f5a-5b24868da656 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:07:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:07:25 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:07:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7f643602-d476-44be-9f5a-5b24868da656 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:25 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7f643602-d476-44be-9f5a-5b24868da656 1073741824 Sep 04 16:07:25 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:25 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-3765a027-0b4b-40a1-bc45-5b90fb92fae0 tempest-CinderUnicodeTest-1859852684 None] Create snapshot completed successfully Sep 04 16:07:25 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-29af6456-36f1-48b6-bd40-335ed626eeec tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952.ff9f1367-1314-4ef3-869a-f93d26a83788" returned: 0 in 0.433s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-29af6456-36f1-48b6-bd40-335ed626eeec tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952.ff9f1367-1314-4ef3-869a-f93d26a83788 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:25 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952.ff9f1367-1314-4ef3-869a-f93d26a83788 Sep 04 16:07:25 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:26 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-29af6456-36f1-48b6-bd40-335ed626eeec tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952.ff9f1367-1314-4ef3-869a-f93d26a83788" returned: 0 in 0.281s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-29af6456-36f1-48b6-bd40-335ed626eeec tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-ff9f1367-1314-4ef3-869a-f93d26a83788" released by "_delete_snapshot" :: held 1.676s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-29af6456-36f1-48b6-bd40-335ed626eeec tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-ae75d8d8-8aa2-467a-b60d-80c919c64952" released by "delete_snapshot" :: held 1.702s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-29af6456-36f1-48b6-bd40-335ed626eeec tempest-ProjectMemberTests-322461420 None] Created reservations ['d19703a8-03d3-4a1c-b8fd-3a924c254841', '8e82142a-f0de-41c7-a9ad-0d1633d12c8b', '6a6e769a-60b9-4eb1-9c19-c6686fbc876f', 'ce140a26-270f-4507-ba5b-a8903cf322d0'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:26 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-29af6456-36f1-48b6-bd40-335ed626eeec tempest-ProjectMemberTests-322461420 None] Delete snapshot completed successfully. Sep 04 16:07:26 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-29af6456-36f1-48b6-bd40-335ed626eeec tempest-ProjectMemberTests-322461420 None] Lock "cinder-ff9f1367-1314-4ef3-869a-f93d26a83788-delete_snapshot" released by "delete_snapshot" :: held 1.852s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7f643602-d476-44be-9f5a-5b24868da656 1073741824" returned: 0 in 0.524s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7f643602-d476-44be-9f5a-5b24868da656 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:26 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7f643602-d476-44be-9f5a-5b24868da656 Sep 04 16:07:26 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7ea57b53-c27c-4afc-b795-c6c63c58c55a tempest-CinderUnicodeTest-1859852684 None] Acquiring lock "cinder-770a72a5-7452-4c7d-aaf3-25ada69f9128-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7ea57b53-c27c-4afc-b795-c6c63c58c55a tempest-CinderUnicodeTest-1859852684 None] Lock "cinder-770a72a5-7452-4c7d-aaf3-25ada69f9128-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7ea57b53-c27c-4afc-b795-c6c63c58c55a tempest-CinderUnicodeTest-1859852684 None] Acquiring lock "cinder-quobyte-62515a89-1969-4b3e-9865-2c8ae0c48c6a" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7ea57b53-c27c-4afc-b795-c6c63c58c55a tempest-CinderUnicodeTest-1859852684 None] Lock "cinder-quobyte-62515a89-1969-4b3e-9865-2c8ae0c48c6a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7ea57b53-c27c-4afc-b795-c6c63c58c55a tempest-CinderUnicodeTest-1859852684 None] Acquiring lock "cinder-quobyte-770a72a5-7452-4c7d-aaf3-25ada69f9128" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7ea57b53-c27c-4afc-b795-c6c63c58c55a tempest-CinderUnicodeTest-1859852684 None] Lock "cinder-quobyte-770a72a5-7452-4c7d-aaf3-25ada69f9128" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-7ea57b53-c27c-4afc-b795-c6c63c58c55a tempest-CinderUnicodeTest-1859852684 None] Deleting offline snapshot 770a72a5-7452-4c7d-aaf3-25ada69f9128 of volume 62515a89-1969-4b3e-9865-2c8ae0c48c6a {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:07:26 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-7ea57b53-c27c-4afc-b795-c6c63c58c55a tempest-CinderUnicodeTest-1859852684 None] snapshot_file for this snap is: volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a.770a72a5-7452-4c7d-aaf3-25ada69f9128 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7f643602-d476-44be-9f5a-5b24868da656" returned: 0 in 0.283s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0c051f-08bc-42e4-8c11-dd3161350225]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7ea57b53-c27c-4afc-b795-c6c63c58c55a tempest-CinderUnicodeTest-1859852684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a.770a72a5-7452-4c7d-aaf3-25ada69f9128 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b6a2cd-4a44-406e-abd8-54ac3731b5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f643602-d476-44be-9f5a-5b24868da656', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1427caef-e8e6-44f2-a599-df97fca8da92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-bac854b8-b9be-4ef0-bf4a-ff758c718980 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-ae75d8d8-8aa2-467a-b60d-80c919c64952-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:26 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Volume volume-7f643602-d476-44be-9f5a-5b24868da656 (7f643602-d476-44be-9f5a-5b24868da656): created successfully Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1427caef-e8e6-44f2-a599-df97fca8da92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Flow 'volume_create_manager' (aa8ef937-6b9c-4d32-b0dc-66cb5f2d314a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-bac854b8-b9be-4ef0-bf4a-ff758c718980 tempest-ProjectMemberTests-322461420 None] Lock "cinder-ae75d8d8-8aa2-467a-b60d-80c919c64952-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:26 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-d06ea8a2-eebc-4563-a037-d48fb753b439 tempest-ProjectReaderTests-2017246261 None] Created volume successfully. Sep 04 16:07:26 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a.770a72a5-7452-4c7d-aaf3-25ada69f9128 Sep 04 16:07:26 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-bac854b8-b9be-4ef0-bf4a-ff758c718980 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-quobyte-ae75d8d8-8aa2-467a-b60d-80c919c64952" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-bac854b8-b9be-4ef0-bf4a-ff758c718980 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-ae75d8d8-8aa2-467a-b60d-80c919c64952" acquired by "delete_volume" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[1338933a-1d33-4f39-b26d-c20888790f6a]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-bac854b8-b9be-4ef0-bf4a-ff758c718980 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:26 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952 Sep 04 16:07:26 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:26 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7ea57b53-c27c-4afc-b795-c6c63c58c55a tempest-CinderUnicodeTest-1859852684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a.770a72a5-7452-4c7d-aaf3-25ada69f9128" returned: 0 in 0.407s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:26 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-7ea57b53-c27c-4afc-b795-c6c63c58c55a tempest-CinderUnicodeTest-1859852684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:07:27 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[4739996e-f018-4dc7-82ba-c9b1b2d4a339]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7ea57b53-c27c-4afc-b795-c6c63c58c55a tempest-CinderUnicodeTest-1859852684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:27 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a Sep 04 16:07:27 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:27 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-bac854b8-b9be-4ef0-bf4a-ff758c718980 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952" returned: 0 in 0.359s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-bac854b8-b9be-4ef0-bf4a-ff758c718980 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:27 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952 Sep 04 16:07:27 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:27 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-bac854b8-b9be-4ef0-bf4a-ff758c718980 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-ae75d8d8-8aa2-467a-b60d-80c919c64952" returned: 0 in 0.253s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:27 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7ea57b53-c27c-4afc-b795-c6c63c58c55a tempest-CinderUnicodeTest-1859852684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a" returned: 0 in 0.399s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7ea57b53-c27c-4afc-b795-c6c63c58c55a tempest-CinderUnicodeTest-1859852684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a.770a72a5-7452-4c7d-aaf3-25ada69f9128 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:27 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-bac854b8-b9be-4ef0-bf4a-ff758c718980 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-ae75d8d8-8aa2-467a-b60d-80c919c64952" released by "delete_volume" :: held 0.689s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:27 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a.770a72a5-7452-4c7d-aaf3-25ada69f9128 Sep 04 16:07:27 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:27 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-bac854b8-b9be-4ef0-bf4a-ff758c718980 tempest-ProjectMemberTests-322461420 None] Created reservations ['a8c361e1-bf06-4033-9070-a3efed9f2903', 'a549aaaf-eb95-4178-a47b-fe130d6625ad', '64217af5-9f0b-4515-97f7-75a07fb5dae4', '967cf40f-bbff-4c2d-a40c-3cd451e92bb6'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-bac854b8-b9be-4ef0-bf4a-ff758c718980 tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-bac854b8-b9be-4ef0-bf4a-ff758c718980 tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:27 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-bac854b8-b9be-4ef0-bf4a-ff758c718980 tempest-ProjectMemberTests-322461420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:27 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-bac854b8-b9be-4ef0-bf4a-ff758c718980 tempest-ProjectMemberTests-322461420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-bac854b8-b9be-4ef0-bf4a-ff758c718980 tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-bac854b8-b9be-4ef0-bf4a-ff758c718980 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:27 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:07:27 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:27 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-67a1be78-05bd-4af1-aa27-a7723f51a330 tempest-ProjectReaderTests-2017246261 None] Acquiring lock "cinder-7f643602-d476-44be-9f5a-5b24868da656-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:27 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-67a1be78-05bd-4af1-aa27-a7723f51a330 tempest-ProjectReaderTests-2017246261 None] Lock "cinder-7f643602-d476-44be-9f5a-5b24868da656-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:27 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-67a1be78-05bd-4af1-aa27-a7723f51a330 tempest-ProjectReaderTests-2017246261 None] Acquiring lock "cinder-quobyte-7f643602-d476-44be-9f5a-5b24868da656" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:27 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-67a1be78-05bd-4af1-aa27-a7723f51a330 tempest-ProjectReaderTests-2017246261 None] Lock "cinder-quobyte-7f643602-d476-44be-9f5a-5b24868da656" acquired by "delete_volume" :: waited 0.016s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:27 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[e785aadb-36d0-49d1-a6aa-fcec4ac7e496]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-67a1be78-05bd-4af1-aa27-a7723f51a330 tempest-ProjectReaderTests-2017246261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7f643602-d476-44be-9f5a-5b24868da656 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:27 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7ea57b53-c27c-4afc-b795-c6c63c58c55a tempest-CinderUnicodeTest-1859852684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a.770a72a5-7452-4c7d-aaf3-25ada69f9128" returned: 0 in 0.466s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7ea57b53-c27c-4afc-b795-c6c63c58c55a tempest-CinderUnicodeTest-1859852684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a.770a72a5-7452-4c7d-aaf3-25ada69f9128 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:27 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7f643602-d476-44be-9f5a-5b24868da656 Sep 04 16:07:27 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:27 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a.770a72a5-7452-4c7d-aaf3-25ada69f9128 Sep 04 16:07:27 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:27 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-bac854b8-b9be-4ef0-bf4a-ff758c718980 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.364s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-bac854b8-b9be-4ef0-bf4a-ff758c718980 tempest-ProjectMemberTests-322461420 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:07:28 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-bac854b8-b9be-4ef0-bf4a-ff758c718980 tempest-ProjectMemberTests-322461420 None] Deleted volume successfully. Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-bac854b8-b9be-4ef0-bf4a-ff758c718980 tempest-ProjectMemberTests-322461420 None] Lock "cinder-ae75d8d8-8aa2-467a-b60d-80c919c64952-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:28 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7ea57b53-c27c-4afc-b795-c6c63c58c55a tempest-CinderUnicodeTest-1859852684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a.770a72a5-7452-4c7d-aaf3-25ada69f9128" returned: 0 in 0.310s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:28 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-67a1be78-05bd-4af1-aa27-a7723f51a330 tempest-ProjectReaderTests-2017246261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7f643602-d476-44be-9f5a-5b24868da656" returned: 0 in 0.463s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-67a1be78-05bd-4af1-aa27-a7723f51a330 tempest-ProjectReaderTests-2017246261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7f643602-d476-44be-9f5a-5b24868da656 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7ea57b53-c27c-4afc-b795-c6c63c58c55a tempest-CinderUnicodeTest-1859852684 None] Lock "cinder-quobyte-770a72a5-7452-4c7d-aaf3-25ada69f9128" released by "_delete_snapshot" :: held 1.744s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7ea57b53-c27c-4afc-b795-c6c63c58c55a tempest-CinderUnicodeTest-1859852684 None] Lock "cinder-quobyte-62515a89-1969-4b3e-9865-2c8ae0c48c6a" released by "delete_snapshot" :: held 1.778s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:28 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7f643602-d476-44be-9f5a-5b24868da656 Sep 04 16:07:28 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-7ea57b53-c27c-4afc-b795-c6c63c58c55a tempest-CinderUnicodeTest-1859852684 None] Created reservations ['f5394c3b-8c6d-4d1a-b75b-b3baf0f47bc2', '3851a7b3-a97b-43ef-bed8-058615f19f52', '3ef86dc4-7c9a-42e0-adba-5a988ab4bb72', 'c742a241-4856-4e4b-9171-f786e09d5326'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:28 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-7ea57b53-c27c-4afc-b795-c6c63c58c55a tempest-CinderUnicodeTest-1859852684 None] Delete snapshot completed successfully. Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-7ea57b53-c27c-4afc-b795-c6c63c58c55a tempest-CinderUnicodeTest-1859852684 None] Lock "cinder-770a72a5-7452-4c7d-aaf3-25ada69f9128-delete_snapshot" released by "delete_snapshot" :: held 1.972s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Flow 'volume_create_manager' (40931e6c-18c2-4628-9151-431197b5ed08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28eae25a-c02b-4836-8e16-4da4f150092f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28eae25a-c02b-4836-8e16-4da4f150092f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-351573263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67dc993fc9ce4300852a9f87ee1ded6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:28Z,use_quota=True,user_id='862f7e66540c4c5baa32a03cb34b0c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (847c3d1a-3311-438b-933a-b5ae077fd1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (847c3d1a-3311-438b-933a-b5ae077fd1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (764de614-74f6-4f3e-b2e4-3f3bae034166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (764de614-74f6-4f3e-b2e4-3f3bae034166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1', 'volume_name': 'volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (984b4e50-6704-42ac-a7d5-9165ab117571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (984b4e50-6704-42ac-a7d5-9165ab117571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a420bbf-bd6b-4c10-b826-ba599372fcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:28 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Volume 8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1', 'volume_size': 1} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-351573263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67dc993fc9ce4300852a9f87ee1ded6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:28Z,use_quota=True,user_id='862f7e66540c4c5baa32a03cb34b0c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Creating volume 8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:07:28 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:07:28 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-67a1be78-05bd-4af1-aa27-a7723f51a330 tempest-ProjectReaderTests-2017246261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-7f643602-d476-44be-9f5a-5b24868da656" returned: 0 in 0.340s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-67a1be78-05bd-4af1-aa27-a7723f51a330 tempest-ProjectReaderTests-2017246261 None] Lock "cinder-quobyte-7f643602-d476-44be-9f5a-5b24868da656" released by "delete_volume" :: held 0.843s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:28 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1 1073741824 Sep 04 16:07:28 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-52152e08-bc94-4954-aaee-e7df18631aa0 tempest-CinderUnicodeTest-1859852684 None] Acquiring lock "cinder-62515a89-1969-4b3e-9865-2c8ae0c48c6a-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-52152e08-bc94-4954-aaee-e7df18631aa0 tempest-CinderUnicodeTest-1859852684 None] Lock "cinder-62515a89-1969-4b3e-9865-2c8ae0c48c6a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-52152e08-bc94-4954-aaee-e7df18631aa0 tempest-CinderUnicodeTest-1859852684 None] Acquiring lock "cinder-quobyte-62515a89-1969-4b3e-9865-2c8ae0c48c6a" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-67a1be78-05bd-4af1-aa27-a7723f51a330 tempest-ProjectReaderTests-2017246261 None] Created reservations ['82d32c56-3256-422e-9df7-3b95ae6c3e90', 'c0203cbc-6cb8-4eb6-9bad-8d0e8f06592c', 'd21a03f8-435c-48f9-b183-c5c8725117b5', 'de935b29-8634-4ef6-981e-e2be42ebcb41'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-52152e08-bc94-4954-aaee-e7df18631aa0 tempest-CinderUnicodeTest-1859852684 None] Lock "cinder-quobyte-62515a89-1969-4b3e-9865-2c8ae0c48c6a" acquired by "delete_volume" :: waited 0.035s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c7a1e0-b19e-402c-9741-a663fd9f3cc6]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-52152e08-bc94-4954-aaee-e7df18631aa0 tempest-CinderUnicodeTest-1859852684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-67a1be78-05bd-4af1-aa27-a7723f51a330 tempest-ProjectReaderTests-2017246261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-67a1be78-05bd-4af1-aa27-a7723f51a330 tempest-ProjectReaderTests-2017246261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-67a1be78-05bd-4af1-aa27-a7723f51a330 tempest-ProjectReaderTests-2017246261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-67a1be78-05bd-4af1-aa27-a7723f51a330 tempest-ProjectReaderTests-2017246261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-67a1be78-05bd-4af1-aa27-a7723f51a330 tempest-ProjectReaderTests-2017246261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-67a1be78-05bd-4af1-aa27-a7723f51a330 tempest-ProjectReaderTests-2017246261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:28 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:07:28 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:28 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a Sep 04 16:07:28 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:29 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:29 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1 1073741824" returned: 0 in 0.607s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-52152e08-bc94-4954-aaee-e7df18631aa0 tempest-CinderUnicodeTest-1859852684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a" returned: 0 in 0.398s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-52152e08-bc94-4954-aaee-e7df18631aa0 tempest-CinderUnicodeTest-1859852684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:29 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-67a1be78-05bd-4af1-aa27-a7723f51a330 tempest-ProjectReaderTests-2017246261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.351s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-67a1be78-05bd-4af1-aa27-a7723f51a330 tempest-ProjectReaderTests-2017246261 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:07:29 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-67a1be78-05bd-4af1-aa27-a7723f51a330 tempest-ProjectReaderTests-2017246261 None] Deleted volume successfully. Sep 04 16:07:29 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a Sep 04 16:07:29 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-67a1be78-05bd-4af1-aa27-a7723f51a330 tempest-ProjectReaderTests-2017246261 None] Lock "cinder-7f643602-d476-44be-9f5a-5b24868da656-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:29 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1 Sep 04 16:07:29 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:29 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-52152e08-bc94-4954-aaee-e7df18631aa0 tempest-CinderUnicodeTest-1859852684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-62515a89-1969-4b3e-9865-2c8ae0c48c6a" returned: 0 in 0.274s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-52152e08-bc94-4954-aaee-e7df18631aa0 tempest-CinderUnicodeTest-1859852684 None] Lock "cinder-quobyte-62515a89-1969-4b3e-9865-2c8ae0c48c6a" released by "delete_volume" :: held 0.747s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:29 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1" returned: 0 in 0.280s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a420bbf-bd6b-4c10-b826-ba599372fcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466ae83d-c50e-46f4-a6ff-453d9b6d93a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-52152e08-bc94-4954-aaee-e7df18631aa0 tempest-CinderUnicodeTest-1859852684 None] Created reservations ['5805156c-e56c-402b-82e6-ac44c3e52641', '5912a94e-451a-4158-8baa-18c5924759ba', '58a98d76-5866-4c74-baca-d0ee389a2d52', 'ae83486b-2beb-4b73-91e8-fed256bf6b01'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:29 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Volume volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1 (8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1): created successfully Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466ae83d-c50e-46f4-a6ff-453d9b6d93a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Flow 'volume_create_manager' (40931e6c-18c2-4628-9151-431197b5ed08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:29 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-3a2e4f96-f23c-4297-bc9b-6f52ed79e34c tempest-ProjectMemberTests-322461420 None] Created volume successfully. Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-52152e08-bc94-4954-aaee-e7df18631aa0 tempest-CinderUnicodeTest-1859852684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-52152e08-bc94-4954-aaee-e7df18631aa0 tempest-CinderUnicodeTest-1859852684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-52152e08-bc94-4954-aaee-e7df18631aa0 tempest-CinderUnicodeTest-1859852684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-52152e08-bc94-4954-aaee-e7df18631aa0 tempest-CinderUnicodeTest-1859852684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-52152e08-bc94-4954-aaee-e7df18631aa0 tempest-CinderUnicodeTest-1859852684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-52152e08-bc94-4954-aaee-e7df18631aa0 tempest-CinderUnicodeTest-1859852684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:29 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:07:29 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-35474ef9-b6aa-40fe-b6a3-f9a067f0f11b tempest-CinderUnicodeTest-1859852684 None] Acquiring lock "cinder-6cad33d7-69fe-45cc-a687-175dd8df85e9-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-35474ef9-b6aa-40fe-b6a3-f9a067f0f11b tempest-CinderUnicodeTest-1859852684 None] Lock "cinder-6cad33d7-69fe-45cc-a687-175dd8df85e9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-35474ef9-b6aa-40fe-b6a3-f9a067f0f11b tempest-CinderUnicodeTest-1859852684 None] Acquiring lock "cinder-quobyte-6cad33d7-69fe-45cc-a687-175dd8df85e9" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-35474ef9-b6aa-40fe-b6a3-f9a067f0f11b tempest-CinderUnicodeTest-1859852684 None] Lock "cinder-quobyte-6cad33d7-69fe-45cc-a687-175dd8df85e9" acquired by "delete_volume" :: waited 0.016s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b968d9-7deb-49e3-98aa-5f35e11851ac]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-35474ef9-b6aa-40fe-b6a3-f9a067f0f11b tempest-CinderUnicodeTest-1859852684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6cad33d7-69fe-45cc-a687-175dd8df85e9 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:29 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-52152e08-bc94-4954-aaee-e7df18631aa0 tempest-CinderUnicodeTest-1859852684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.315s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:29 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-52152e08-bc94-4954-aaee-e7df18631aa0 tempest-CinderUnicodeTest-1859852684 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:07:30 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-52152e08-bc94-4954-aaee-e7df18631aa0 tempest-CinderUnicodeTest-1859852684 None] Deleted volume successfully. Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=254,cinder:UPDATE=340,cinder:DELETE=29,cinder:INSERT=88 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-52152e08-bc94-4954-aaee-e7df18631aa0 tempest-CinderUnicodeTest-1859852684 None] Lock "cinder-62515a89-1969-4b3e-9865-2c8ae0c48c6a-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:30 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6cad33d7-69fe-45cc-a687-175dd8df85e9 Sep 04 16:07:30 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:30 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-35474ef9-b6aa-40fe-b6a3-f9a067f0f11b tempest-CinderUnicodeTest-1859852684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6cad33d7-69fe-45cc-a687-175dd8df85e9" returned: 0 in 0.427s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-35474ef9-b6aa-40fe-b6a3-f9a067f0f11b tempest-CinderUnicodeTest-1859852684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6cad33d7-69fe-45cc-a687-175dd8df85e9 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:30 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6cad33d7-69fe-45cc-a687-175dd8df85e9 Sep 04 16:07:30 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:UPDATE=353,cinder:SELECT=247,cinder:INSERT=93,cinder:DELETE=33 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Flow 'volume_create_manager' (7b488d43-8668-44d6-869b-f983089a2e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6ba8ed-6674-488f-b1f9-b1fe0b2646fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6ba8ed-6674-488f-b1f9-b1fe0b2646fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-985109058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3770e9b2-a90a-49d9-bd7e-c12466758049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='180cbaf2ee144b068a15941013944017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:30Z,use_quota=True,user_id='69651994bda64203985f0df267c9d8df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf2f5e9-400f-47dd-ba08-024dcf22b4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf2f5e9-400f-47dd-ba08-024dcf22b4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cf7a18e-a07a-46d2-b7c1-3a6559fed0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cf7a18e-a07a-46d2-b7c1-3a6559fed0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3770e9b2-a90a-49d9-bd7e-c12466758049', 'volume_name': 'volume-3770e9b2-a90a-49d9-bd7e-c12466758049', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9968d47-76c6-46d3-bb7e-317abf3d064e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9968d47-76c6-46d3-bb7e-317abf3d064e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c44150d-dce3-4c5e-9470-aa8a1fa6154c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:30 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Volume 3770e9b2-a90a-49d9-bd7e-c12466758049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3770e9b2-a90a-49d9-bd7e-c12466758049', 'volume_size': 1} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-985109058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3770e9b2-a90a-49d9-bd7e-c12466758049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='180cbaf2ee144b068a15941013944017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:30Z,use_quota=True,user_id='69651994bda64203985f0df267c9d8df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Creating volume 3770e9b2-a90a-49d9-bd7e-c12466758049 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:07:30 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3770e9b2-a90a-49d9-bd7e-c12466758049 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:30 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3770e9b2-a90a-49d9-bd7e-c12466758049 1073741824 Sep 04 16:07:30 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:30 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-35474ef9-b6aa-40fe-b6a3-f9a067f0f11b tempest-CinderUnicodeTest-1859852684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-6cad33d7-69fe-45cc-a687-175dd8df85e9" returned: 0 in 0.355s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-35474ef9-b6aa-40fe-b6a3-f9a067f0f11b tempest-CinderUnicodeTest-1859852684 None] Lock "cinder-quobyte-6cad33d7-69fe-45cc-a687-175dd8df85e9" released by "delete_volume" :: held 0.838s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-16242cc1-a397-4447-95c3-136da97c92a1 tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-35474ef9-b6aa-40fe-b6a3-f9a067f0f11b tempest-CinderUnicodeTest-1859852684 None] Created reservations ['f0110226-f701-4e44-b39a-e864a137f7d8', '571d62d3-65e2-422c-ab4e-9bbc55e5796c', '8848e521-8e0d-444c-aea6-4b5d3e99f026', 'effa4b07-835d-4f73-8046-fed344dd7cb4'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-35474ef9-b6aa-40fe-b6a3-f9a067f0f11b tempest-CinderUnicodeTest-1859852684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-35474ef9-b6aa-40fe-b6a3-f9a067f0f11b tempest-CinderUnicodeTest-1859852684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-35474ef9-b6aa-40fe-b6a3-f9a067f0f11b tempest-CinderUnicodeTest-1859852684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-35474ef9-b6aa-40fe-b6a3-f9a067f0f11b tempest-CinderUnicodeTest-1859852684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-35474ef9-b6aa-40fe-b6a3-f9a067f0f11b tempest-CinderUnicodeTest-1859852684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-35474ef9-b6aa-40fe-b6a3-f9a067f0f11b tempest-CinderUnicodeTest-1859852684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:30 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:07:30 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:31 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3770e9b2-a90a-49d9-bd7e-c12466758049 1073741824" returned: 0 in 0.511s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:31 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-35474ef9-b6aa-40fe-b6a3-f9a067f0f11b tempest-CinderUnicodeTest-1859852684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.309s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:31 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-35474ef9-b6aa-40fe-b6a3-f9a067f0f11b tempest-CinderUnicodeTest-1859852684 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:07:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3770e9b2-a90a-49d9-bd7e-c12466758049 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:31 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-35474ef9-b6aa-40fe-b6a3-f9a067f0f11b tempest-CinderUnicodeTest-1859852684 None] Deleted volume successfully. Sep 04 16:07:31 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3770e9b2-a90a-49d9-bd7e-c12466758049 Sep 04 16:07:31 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-35474ef9-b6aa-40fe-b6a3-f9a067f0f11b tempest-CinderUnicodeTest-1859852684 None] Lock "cinder-6cad33d7-69fe-45cc-a687-175dd8df85e9-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:31 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3770e9b2-a90a-49d9-bd7e-c12466758049" returned: 0 in 0.312s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:31 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:07:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-16242cc1-a397-4447-95c3-136da97c92a1 tempest-ProjectMemberTests-322461420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.742s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c44150d-dce3-4c5e-9470-aa8a1fa6154c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3770e9b2-a90a-49d9-bd7e-c12466758049', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f7c7ab-edaf-442f-833a-4d6b377d630f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:31 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-16242cc1-a397-4447-95c3-136da97c92a1 tempest-ProjectMemberTests-322461420 None] Creating offline snapshot a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19 of volume 8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1 {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:07:31 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Volume volume-3770e9b2-a90a-49d9-bd7e-c12466758049 (3770e9b2-a90a-49d9-bd7e-c12466758049): created successfully Sep 04 16:07:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f7c7ab-edaf-442f-833a-4d6b377d630f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:31 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Flow 'volume_create_manager' (7b488d43-8668-44d6-869b-f983089a2e2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:31 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[676b2f07-03f6-4220-a7fb-6a47c46b53a2]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-16242cc1-a397-4447-95c3-136da97c92a1 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:31 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-2d6bbbf2-db5b-4339-a78c-84d4a5b080a6 tempest-ProjectReaderTests-2017246261 None] Created volume successfully. Sep 04 16:07:31 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1 Sep 04 16:07:31 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:32 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-16242cc1-a397-4447-95c3-136da97c92a1 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1" returned: 0 in 0.441s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-16242cc1-a397-4447-95c3-136da97c92a1 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1.a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:32 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1.a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19 1G Sep 04 16:07:32 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:32 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-16242cc1-a397-4447-95c3-136da97c92a1 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1.a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19 1G" returned: 0 in 0.544s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-16242cc1-a397-4447-95c3-136da97c92a1 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1.a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:32 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1.a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19 Sep 04 16:07:32 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2cc3ff53-0081-4dd2-b0a5-7832eda538ce tempest-ProjectReaderTests-2017246261 None] Acquiring lock "cinder-3770e9b2-a90a-49d9-bd7e-c12466758049-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2cc3ff53-0081-4dd2-b0a5-7832eda538ce tempest-ProjectReaderTests-2017246261 None] Lock "cinder-3770e9b2-a90a-49d9-bd7e-c12466758049-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2cc3ff53-0081-4dd2-b0a5-7832eda538ce tempest-ProjectReaderTests-2017246261 None] Acquiring lock "cinder-quobyte-3770e9b2-a90a-49d9-bd7e-c12466758049" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2cc3ff53-0081-4dd2-b0a5-7832eda538ce tempest-ProjectReaderTests-2017246261 None] Lock "cinder-quobyte-3770e9b2-a90a-49d9-bd7e-c12466758049" acquired by "delete_volume" :: waited 0.016s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:32 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[a221c554-4508-4196-a448-7dd514ba4453]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2cc3ff53-0081-4dd2-b0a5-7832eda538ce tempest-ProjectReaderTests-2017246261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3770e9b2-a90a-49d9-bd7e-c12466758049 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:32 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3770e9b2-a90a-49d9-bd7e-c12466758049 Sep 04 16:07:32 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:33 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-16242cc1-a397-4447-95c3-136da97c92a1 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1.a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19" returned: 0 in 0.430s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:33 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-16242cc1-a397-4447-95c3-136da97c92a1 tempest-ProjectMemberTests-322461420 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1.a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19 is being set with open permissions: ugo+rw Sep 04 16:07:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-16242cc1-a397-4447-95c3-136da97c92a1 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1.a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:33 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1.a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19 Sep 04 16:07:33 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:33 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2cc3ff53-0081-4dd2-b0a5-7832eda538ce tempest-ProjectReaderTests-2017246261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3770e9b2-a90a-49d9-bd7e-c12466758049" returned: 0 in 0.478s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2cc3ff53-0081-4dd2-b0a5-7832eda538ce tempest-ProjectReaderTests-2017246261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3770e9b2-a90a-49d9-bd7e-c12466758049 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:33 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3770e9b2-a90a-49d9-bd7e-c12466758049 Sep 04 16:07:33 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:33 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-16242cc1-a397-4447-95c3-136da97c92a1 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1.a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19" returned: 0 in 0.318s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-16242cc1-a397-4447-95c3-136da97c92a1 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:33 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1.info Sep 04 16:07:33 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:33 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2cc3ff53-0081-4dd2-b0a5-7832eda538ce tempest-ProjectReaderTests-2017246261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3770e9b2-a90a-49d9-bd7e-c12466758049" returned: 0 in 0.267s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:33 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2cc3ff53-0081-4dd2-b0a5-7832eda538ce tempest-ProjectReaderTests-2017246261 None] Lock "cinder-quobyte-3770e9b2-a90a-49d9-bd7e-c12466758049" released by "delete_volume" :: held 0.799s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:33 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-2cc3ff53-0081-4dd2-b0a5-7832eda538ce tempest-ProjectReaderTests-2017246261 None] Created reservations ['d6690e47-ceed-445e-b45d-06b4df64a78f', 'cd1e7721-5f3c-4adf-a491-40c2aa22c677', '7e342b82-4eb2-4eb0-9942-8c13f5af3f25', 'b7277cb6-943a-466c-89bf-5270ee8ff18f'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2cc3ff53-0081-4dd2-b0a5-7832eda538ce tempest-ProjectReaderTests-2017246261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2cc3ff53-0081-4dd2-b0a5-7832eda538ce tempest-ProjectReaderTests-2017246261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:33 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2cc3ff53-0081-4dd2-b0a5-7832eda538ce tempest-ProjectReaderTests-2017246261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:33 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2cc3ff53-0081-4dd2-b0a5-7832eda538ce tempest-ProjectReaderTests-2017246261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2cc3ff53-0081-4dd2-b0a5-7832eda538ce tempest-ProjectReaderTests-2017246261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2cc3ff53-0081-4dd2-b0a5-7832eda538ce tempest-ProjectReaderTests-2017246261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:33 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-16242cc1-a397-4447-95c3-136da97c92a1 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1.info" returned: 0 in 0.368s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:33 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-16242cc1-a397-4447-95c3-136da97c92a1 tempest-ProjectMemberTests-322461420 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1.info is being set with open permissions: ugo+rw Sep 04 16:07:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-16242cc1-a397-4447-95c3-136da97c92a1 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:33 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:07:33 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:33 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1.info Sep 04 16:07:33 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:34 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-16242cc1-a397-4447-95c3-136da97c92a1 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1.info" returned: 0 in 0.355s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-16242cc1-a397-4447-95c3-136da97c92a1 tempest-ProjectMemberTests-322461420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.584s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:34 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2cc3ff53-0081-4dd2-b0a5-7832eda538ce tempest-ProjectReaderTests-2017246261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.428s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:34 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-2cc3ff53-0081-4dd2-b0a5-7832eda538ce tempest-ProjectReaderTests-2017246261 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:07:34 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-2cc3ff53-0081-4dd2-b0a5-7832eda538ce tempest-ProjectReaderTests-2017246261 None] Deleted volume successfully. Sep 04 16:07:34 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-16242cc1-a397-4447-95c3-136da97c92a1 tempest-ProjectMemberTests-322461420 None] Create snapshot completed successfully Sep 04 16:07:34 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2cc3ff53-0081-4dd2-b0a5-7832eda538ce tempest-ProjectReaderTests-2017246261 None] Lock "cinder-3770e9b2-a90a-49d9-bd7e-c12466758049-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:34 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:07:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Flow 'volume_create_manager' (4b1cdf90-1ea5-4163-9c86-9128d8714336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be04d162-7231-44eb-8575-e5cacd2a5416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be04d162-7231-44eb-8575-e5cacd2a5416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1846563361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d109122bf84b415d9086c05a28136dc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:35Z,use_quota=True,user_id='ac8b6cb0ead44778a39bb00c297a9126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f132732-cb07-46ae-8418-a8dc979c6e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f132732-cb07-46ae-8418-a8dc979c6e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd9754c0-be2d-4cdd-aab7-794480dbed0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd9754c0-be2d-4cdd-aab7-794480dbed0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29', 'volume_name': 'volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7dafc4f-4ad5-416f-850a-c6d78eec484b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7dafc4f-4ad5-416f-850a-c6d78eec484b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46c5345-17d5-4d71-af6b-b63894a5324d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:34 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Volume f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29', 'volume_size': 1} Sep 04 16:07:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1846563361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d109122bf84b415d9086c05a28136dc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:35Z,use_quota=True,user_id='ac8b6cb0ead44778a39bb00c297a9126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:07:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Creating volume f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:07:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:07:34 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:07:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:35 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29 1073741824 Sep 04 16:07:35 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-71c53890-1af5-4eb9-a85c-24485ef8d283 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-71c53890-1af5-4eb9-a85c-24485ef8d283 tempest-ProjectMemberTests-322461420 None] Lock "cinder-a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-71c53890-1af5-4eb9-a85c-24485ef8d283 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-quobyte-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-71c53890-1af5-4eb9-a85c-24485ef8d283 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-71c53890-1af5-4eb9-a85c-24485ef8d283 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-quobyte-a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:35 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-71c53890-1af5-4eb9-a85c-24485ef8d283 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-71c53890-1af5-4eb9-a85c-24485ef8d283 tempest-ProjectMemberTests-322461420 None] Deleting offline snapshot a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19 of volume 8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:07:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-71c53890-1af5-4eb9-a85c-24485ef8d283 tempest-ProjectMemberTests-322461420 None] snapshot_file for this snap is: volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1.a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:07:35 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[a595c2c0-f604-457c-8fb2-b2f03ff8d79a]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-71c53890-1af5-4eb9-a85c-24485ef8d283 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1.a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:35 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1.a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19 Sep 04 16:07:35 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:35 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29 1073741824" returned: 0 in 0.567s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:35 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29 Sep 04 16:07:35 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-6e2c7a7b-7e0e-42bb-a4da-fa7fc8942086 tempest-ProjectAdminTests-1597987905 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7594451904297, 'free_capacity_gb': 1773.7594451904297, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87490) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 04 16:07:35 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-71c53890-1af5-4eb9-a85c-24485ef8d283 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1.a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19" returned: 0 in 0.457s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-71c53890-1af5-4eb9-a85c-24485ef8d283 tempest-ProjectMemberTests-322461420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:07:35 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[7579b708-b176-4b80-a65e-98d8e3516013]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-71c53890-1af5-4eb9-a85c-24485ef8d283 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:35 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29" returned: 0 in 0.323s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:07:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:35 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1 Sep 04 16:07:35 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46c5345-17d5-4d71-af6b-b63894a5324d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c4059d-11d4-4411-8eaa-a58c5215c15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:35 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Volume volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29 (f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29): created successfully Sep 04 16:07:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c4059d-11d4-4411-8eaa-a58c5215c15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Flow 'volume_create_manager' (4b1cdf90-1ea5-4163-9c86-9128d8714336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:36 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-130889d6-430a-40ec-9a7a-51225b0ea61f tempest-ProjectReaderTests-421961720 None] Created volume successfully. Sep 04 16:07:36 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-71c53890-1af5-4eb9-a85c-24485ef8d283 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1" returned: 0 in 0.442s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-71c53890-1af5-4eb9-a85c-24485ef8d283 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1.a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:36 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1.a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19 Sep 04 16:07:36 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:36 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-71c53890-1af5-4eb9-a85c-24485ef8d283 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1.a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19" returned: 0 in 0.375s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-71c53890-1af5-4eb9-a85c-24485ef8d283 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1.a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:36 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1.a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19 Sep 04 16:07:36 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:36 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-71c53890-1af5-4eb9-a85c-24485ef8d283 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1.a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19" returned: 0 in 0.257s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:36 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-71c53890-1af5-4eb9-a85c-24485ef8d283 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19" released by "_delete_snapshot" :: held 1.707s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:36 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-71c53890-1af5-4eb9-a85c-24485ef8d283 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1" released by "delete_snapshot" :: held 1.759s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:37 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-71c53890-1af5-4eb9-a85c-24485ef8d283 tempest-ProjectMemberTests-322461420 None] Created reservations ['96d0cea2-b5a2-4633-acec-d47420fa0a08', '715aa7c8-eb89-4b1f-a9e8-725008350665', '6589aa40-0e73-4486-b777-a07d70f0dc33', 'bfb024a7-7740-48b2-9748-1fc8b7c2d3c1'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:37 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-71c53890-1af5-4eb9-a85c-24485ef8d283 tempest-ProjectMemberTests-322461420 None] Delete snapshot completed successfully. Sep 04 16:07:37 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-71c53890-1af5-4eb9-a85c-24485ef8d283 tempest-ProjectMemberTests-322461420 None] Lock "cinder-a2f781bc-3bc4-48b2-bcbd-92cdddf6fa19-delete_snapshot" released by "delete_snapshot" :: held 1.977s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5396b65f-d9df-4bcb-ac6f-a55e8543f0ff tempest-ProjectReaderTests-421961720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5396b65f-d9df-4bcb-ac6f-a55e8543f0ff tempest-ProjectReaderTests-421961720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:37 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-5396b65f-d9df-4bcb-ac6f-a55e8543f0ff tempest-ProjectReaderTests-421961720 None] Creating offline snapshot 18c6bb84-ad80-495c-bb7a-a67d775659a1 of volume f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29 {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:07:37 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[244f3789-9a07-4eef-85ad-7182788eda7e]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5396b65f-d9df-4bcb-ac6f-a55e8543f0ff tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:37 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-06872885-d478-4289-8fb2-216c9c56d5e4 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:37 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-06872885-d478-4289-8fb2-216c9c56d5e4 tempest-ProjectMemberTests-322461420 None] Lock "cinder-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:37 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-06872885-d478-4289-8fb2-216c9c56d5e4 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-quobyte-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:37 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-06872885-d478-4289-8fb2-216c9c56d5e4 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1" acquired by "delete_volume" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:37 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29 Sep 04 16:07:37 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:37 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[56160e8f-35cc-4c96-9a43-5a9be9f2cc35]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-06872885-d478-4289-8fb2-216c9c56d5e4 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:37 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1 Sep 04 16:07:37 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:37 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5396b65f-d9df-4bcb-ac6f-a55e8543f0ff tempest-ProjectReaderTests-421961720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29" returned: 0 in 0.472s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5396b65f-d9df-4bcb-ac6f-a55e8543f0ff tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29.18c6bb84-ad80-495c-bb7a-a67d775659a1 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:37 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29.18c6bb84-ad80-495c-bb7a-a67d775659a1 1G Sep 04 16:07:37 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:37 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-06872885-d478-4289-8fb2-216c9c56d5e4 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1" returned: 0 in 0.435s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-06872885-d478-4289-8fb2-216c9c56d5e4 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:38 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1 Sep 04 16:07:38 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:38 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:07:38 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:38 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-06872885-d478-4289-8fb2-216c9c56d5e4 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1" returned: 0 in 0.299s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-06872885-d478-4289-8fb2-216c9c56d5e4 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1" released by "delete_volume" :: held 0.804s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-06872885-d478-4289-8fb2-216c9c56d5e4 tempest-ProjectMemberTests-322461420 None] Created reservations ['36a15e47-139d-40d5-84e7-a461ab8d4260', '3ba9efdc-8843-4c1f-823c-038a7a61f874', 'e071c5da-bdfc-4820-89b1-6f71f5ab88d6', 'c08e9423-d6cb-4b16-a53f-1b54c326edc4'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:38 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5396b65f-d9df-4bcb-ac6f-a55e8543f0ff tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29.18c6bb84-ad80-495c-bb7a-a67d775659a1 1G" returned: 0 in 0.570s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5396b65f-d9df-4bcb-ac6f-a55e8543f0ff tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29.18c6bb84-ad80-495c-bb7a-a67d775659a1 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:38 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29.18c6bb84-ad80-495c-bb7a-a67d775659a1 Sep 04 16:07:38 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-06872885-d478-4289-8fb2-216c9c56d5e4 tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-06872885-d478-4289-8fb2-216c9c56d5e4 tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-06872885-d478-4289-8fb2-216c9c56d5e4 tempest-ProjectMemberTests-322461420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-06872885-d478-4289-8fb2-216c9c56d5e4 tempest-ProjectMemberTests-322461420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-06872885-d478-4289-8fb2-216c9c56d5e4 tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-06872885-d478-4289-8fb2-216c9c56d5e4 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:38 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:07:38 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:38 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.369s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager._thread_info {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread count: 29 {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread info: [<_MainThread(MainThread, started 138899118923904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 16:07:38 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-06872885-d478-4289-8fb2-216c9c56d5e4 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.341s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-06872885-d478-4289-8fb2-216c9c56d5e4 tempest-ProjectMemberTests-322461420 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:07:38 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-06872885-d478-4289-8fb2-216c9c56d5e4 tempest-ProjectMemberTests-322461420 None] Deleted volume successfully. Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-06872885-d478-4289-8fb2-216c9c56d5e4 tempest-ProjectMemberTests-322461420 None] Lock "cinder-8bb6a899-f1d3-4c3b-a2c9-beaf1b02beb1-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:38 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5396b65f-d9df-4bcb-ac6f-a55e8543f0ff tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29.18c6bb84-ad80-495c-bb7a-a67d775659a1" returned: 0 in 0.473s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:38 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-5396b65f-d9df-4bcb-ac6f-a55e8543f0ff tempest-ProjectReaderTests-421961720 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29.18c6bb84-ad80-495c-bb7a-a67d775659a1 is being set with open permissions: ugo+rw Sep 04 16:07:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5396b65f-d9df-4bcb-ac6f-a55e8543f0ff tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29.18c6bb84-ad80-495c-bb7a-a67d775659a1 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:38 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29.18c6bb84-ad80-495c-bb7a-a67d775659a1 Sep 04 16:07:38 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:39 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5396b65f-d9df-4bcb-ac6f-a55e8543f0ff tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29.18c6bb84-ad80-495c-bb7a-a67d775659a1" returned: 0 in 0.302s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Flow 'volume_create_manager' (e8b4a7f2-8a74-4b04-9b29-13ab258af999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6341ba6-704a-40ca-af02-766c5eec3191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5396b65f-d9df-4bcb-ac6f-a55e8543f0ff tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:39 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29.info Sep 04 16:07:39 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6341ba6-704a-40ca-af02-766c5eec3191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-267063738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e16f76d-5390-40c2-a0c6-d80ade51a020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67dc993fc9ce4300852a9f87ee1ded6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:39Z,use_quota=True,user_id='862f7e66540c4c5baa32a03cb34b0c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8986dd23-9781-4e23-8fa3-00d4b99e3975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8986dd23-9781-4e23-8fa3-00d4b99e3975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9dc153-77df-4f20-83b7-9833302f6f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9dc153-77df-4f20-83b7-9833302f6f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e16f76d-5390-40c2-a0c6-d80ade51a020', 'volume_name': 'volume-3e16f76d-5390-40c2-a0c6-d80ade51a020', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad0bedc-bdf6-48b2-b3d4-d219c0257e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad0bedc-bdf6-48b2-b3d4-d219c0257e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9df270e-72e9-4c2e-a658-9cb6933f0619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:39 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Volume 3e16f76d-5390-40c2-a0c6-d80ade51a020: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e16f76d-5390-40c2-a0c6-d80ade51a020', 'volume_size': 1} Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:39 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5396b65f-d9df-4bcb-ac6f-a55e8543f0ff tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29.info" returned: 0 in 0.310s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:39 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-5396b65f-d9df-4bcb-ac6f-a55e8543f0ff tempest-ProjectReaderTests-421961720 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29.info is being set with open permissions: ugo+rw Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5396b65f-d9df-4bcb-ac6f-a55e8543f0ff tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:39 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29.info Sep 04 16:07:39 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:39 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5396b65f-d9df-4bcb-ac6f-a55e8543f0ff tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29.info" returned: 0 in 0.255s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5396b65f-d9df-4bcb-ac6f-a55e8543f0ff tempest-ProjectReaderTests-421961720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.523s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.505s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-267063738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e16f76d-5390-40c2-a0c6-d80ade51a020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67dc993fc9ce4300852a9f87ee1ded6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:39Z,use_quota=True,user_id='862f7e66540c4c5baa32a03cb34b0c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Creating volume 3e16f76d-5390-40c2-a0c6-d80ade51a020 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:07:39 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:07:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:39 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020 1073741824 Sep 04 16:07:39 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:39 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-5396b65f-d9df-4bcb-ac6f-a55e8543f0ff tempest-ProjectReaderTests-421961720 None] Create snapshot completed successfully Sep 04 16:07:40 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020 1073741824" returned: 0 in 0.459s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:40 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020 Sep 04 16:07:40 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3830987c-e735-4700-a661-d7b5f31caf42 tempest-ProjectReaderTests-421961720 None] Acquiring lock "cinder-18c6bb84-ad80-495c-bb7a-a67d775659a1-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:40 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3830987c-e735-4700-a661-d7b5f31caf42 tempest-ProjectReaderTests-421961720 None] Lock "cinder-18c6bb84-ad80-495c-bb7a-a67d775659a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3830987c-e735-4700-a661-d7b5f31caf42 tempest-ProjectReaderTests-421961720 None] Acquiring lock "cinder-quobyte-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020" returned: 0 in 0.287s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:40 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:07:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9df270e-72e9-4c2e-a658-9cb6933f0619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e16f76d-5390-40c2-a0c6-d80ade51a020', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089909d7-e9b0-4e74-9f92-90c40a20423a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3830987c-e735-4700-a661-d7b5f31caf42 tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3830987c-e735-4700-a661-d7b5f31caf42 tempest-ProjectReaderTests-421961720 None] Acquiring lock "cinder-quobyte-18c6bb84-ad80-495c-bb7a-a67d775659a1" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:40 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Volume volume-3e16f76d-5390-40c2-a0c6-d80ade51a020 (3e16f76d-5390-40c2-a0c6-d80ade51a020): created successfully Sep 04 16:07:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089909d7-e9b0-4e74-9f92-90c40a20423a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:40 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Flow 'volume_create_manager' (e8b4a7f2-8a74-4b04-9b29-13ab258af999) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3830987c-e735-4700-a661-d7b5f31caf42 tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-18c6bb84-ad80-495c-bb7a-a67d775659a1" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:40 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-3830987c-e735-4700-a661-d7b5f31caf42 tempest-ProjectReaderTests-421961720 None] Deleting offline snapshot 18c6bb84-ad80-495c-bb7a-a67d775659a1 of volume f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:07:40 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-3830987c-e735-4700-a661-d7b5f31caf42 tempest-ProjectReaderTests-421961720 None] snapshot_file for this snap is: volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29.18c6bb84-ad80-495c-bb7a-a67d775659a1 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:07:40 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-78240a50-6a7b-4f6e-8958-689d8946baa0 tempest-ProjectMemberTests-322461420 None] Created volume successfully. Sep 04 16:07:40 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47cf980-8e64-44d0-aa7b-92391ffd4c92]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3830987c-e735-4700-a661-d7b5f31caf42 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29.18c6bb84-ad80-495c-bb7a-a67d775659a1 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:40 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29.18c6bb84-ad80-495c-bb7a-a67d775659a1 Sep 04 16:07:40 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:41 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3830987c-e735-4700-a661-d7b5f31caf42 tempest-ProjectReaderTests-421961720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29.18c6bb84-ad80-495c-bb7a-a67d775659a1" returned: 0 in 0.418s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:41 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-3830987c-e735-4700-a661-d7b5f31caf42 tempest-ProjectReaderTests-421961720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:07:41 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80abded-2ab4-4a77-80d5-8027fe0e9c6b]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3830987c-e735-4700-a661-d7b5f31caf42 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:41 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29 Sep 04 16:07:41 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2cdb2739-1016-4773-8a53-7fce7dd6a2cb tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2cdb2739-1016-4773-8a53-7fce7dd6a2cb tempest-ProjectMemberTests-322461420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:41 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-2cdb2739-1016-4773-8a53-7fce7dd6a2cb tempest-ProjectMemberTests-322461420 None] Creating offline snapshot 4d93775d-12b7-4460-adb3-957480dcb3ce of volume 3e16f76d-5390-40c2-a0c6-d80ade51a020 {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:07:41 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[113b4709-4a3f-4c40-a0d1-12fdce2f5764]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2cdb2739-1016-4773-8a53-7fce7dd6a2cb tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:41 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3830987c-e735-4700-a661-d7b5f31caf42 tempest-ProjectReaderTests-421961720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29" returned: 0 in 0.407s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3830987c-e735-4700-a661-d7b5f31caf42 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29.18c6bb84-ad80-495c-bb7a-a67d775659a1 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:41 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29.18c6bb84-ad80-495c-bb7a-a67d775659a1 Sep 04 16:07:41 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:41 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020 Sep 04 16:07:41 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:41 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2cdb2739-1016-4773-8a53-7fce7dd6a2cb tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020" returned: 0 in 0.399s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2cdb2739-1016-4773-8a53-7fce7dd6a2cb tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020.4d93775d-12b7-4460-adb3-957480dcb3ce 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:41 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020.4d93775d-12b7-4460-adb3-957480dcb3ce 1G Sep 04 16:07:41 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:42 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3830987c-e735-4700-a661-d7b5f31caf42 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29.18c6bb84-ad80-495c-bb7a-a67d775659a1" returned: 0 in 0.417s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3830987c-e735-4700-a661-d7b5f31caf42 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29.18c6bb84-ad80-495c-bb7a-a67d775659a1 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:42 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29.18c6bb84-ad80-495c-bb7a-a67d775659a1 Sep 04 16:07:42 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:42 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3830987c-e735-4700-a661-d7b5f31caf42 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29.18c6bb84-ad80-495c-bb7a-a67d775659a1" returned: 0 in 0.276s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:42 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3830987c-e735-4700-a661-d7b5f31caf42 tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-18c6bb84-ad80-495c-bb7a-a67d775659a1" released by "_delete_snapshot" :: held 1.646s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:42 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3830987c-e735-4700-a661-d7b5f31caf42 tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29" released by "delete_snapshot" :: held 1.697s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:42 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2cdb2739-1016-4773-8a53-7fce7dd6a2cb tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020.4d93775d-12b7-4460-adb3-957480dcb3ce 1G" returned: 0 in 0.514s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2cdb2739-1016-4773-8a53-7fce7dd6a2cb tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e16f76d-5390-40c2-a0c6-d80ade51a020 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020.4d93775d-12b7-4460-adb3-957480dcb3ce {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:42 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-3830987c-e735-4700-a661-d7b5f31caf42 tempest-ProjectReaderTests-421961720 None] Created reservations ['c7c324cd-0c03-411c-8adf-de5fe390ffd8', 'dc45609a-45e5-412a-92df-c539d2d0f1e8', '653ecb4b-b51f-4d68-9022-5c50ce8e89b8', '63f1ac43-fc12-4f82-9eef-753e6c6e6e92'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:42 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e16f76d-5390-40c2-a0c6-d80ade51a020 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020.4d93775d-12b7-4460-adb3-957480dcb3ce Sep 04 16:07:42 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:42 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-3830987c-e735-4700-a661-d7b5f31caf42 tempest-ProjectReaderTests-421961720 None] Delete snapshot completed successfully. Sep 04 16:07:42 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3830987c-e735-4700-a661-d7b5f31caf42 tempest-ProjectReaderTests-421961720 None] Lock "cinder-18c6bb84-ad80-495c-bb7a-a67d775659a1-delete_snapshot" released by "delete_snapshot" :: held 1.910s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:42 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2cdb2739-1016-4773-8a53-7fce7dd6a2cb tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e16f76d-5390-40c2-a0c6-d80ade51a020 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020.4d93775d-12b7-4460-adb3-957480dcb3ce" returned: 0 in 0.360s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:42 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-2cdb2739-1016-4773-8a53-7fce7dd6a2cb tempest-ProjectMemberTests-322461420 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020.4d93775d-12b7-4460-adb3-957480dcb3ce is being set with open permissions: ugo+rw Sep 04 16:07:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2cdb2739-1016-4773-8a53-7fce7dd6a2cb tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020.4d93775d-12b7-4460-adb3-957480dcb3ce {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:42 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a487f8cb-b793-4d5a-ae7d-bc5e3145b921 tempest-ProjectReaderTests-421961720 None] Acquiring lock "cinder-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:42 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020.4d93775d-12b7-4460-adb3-957480dcb3ce Sep 04 16:07:42 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:42 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a487f8cb-b793-4d5a-ae7d-bc5e3145b921 tempest-ProjectReaderTests-421961720 None] Lock "cinder-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:42 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a487f8cb-b793-4d5a-ae7d-bc5e3145b921 tempest-ProjectReaderTests-421961720 None] Acquiring lock "cinder-quobyte-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:42 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a487f8cb-b793-4d5a-ae7d-bc5e3145b921 tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29" acquired by "delete_volume" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:42 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e1802c-6250-46f4-aefc-139da5503139]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:42 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a487f8cb-b793-4d5a-ae7d-bc5e3145b921 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:43 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29 Sep 04 16:07:43 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:43 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2cdb2739-1016-4773-8a53-7fce7dd6a2cb tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020.4d93775d-12b7-4460-adb3-957480dcb3ce" returned: 0 in 0.292s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2cdb2739-1016-4773-8a53-7fce7dd6a2cb tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:43 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020.info Sep 04 16:07:43 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:43 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a487f8cb-b793-4d5a-ae7d-bc5e3145b921 tempest-ProjectReaderTests-421961720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29" returned: 0 in 0.403s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a487f8cb-b793-4d5a-ae7d-bc5e3145b921 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:43 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29 Sep 04 16:07:43 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:43 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2cdb2739-1016-4773-8a53-7fce7dd6a2cb tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020.info" returned: 0 in 0.294s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:43 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-2cdb2739-1016-4773-8a53-7fce7dd6a2cb tempest-ProjectMemberTests-322461420 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020.info is being set with open permissions: ugo+rw Sep 04 16:07:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2cdb2739-1016-4773-8a53-7fce7dd6a2cb tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:43 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020.info Sep 04 16:07:43 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:43 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a487f8cb-b793-4d5a-ae7d-bc5e3145b921 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29" returned: 0 in 0.285s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:43 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a487f8cb-b793-4d5a-ae7d-bc5e3145b921 tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29" released by "delete_volume" :: held 0.765s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:43 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2cdb2739-1016-4773-8a53-7fce7dd6a2cb tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020.info" returned: 0 in 0.277s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2cdb2739-1016-4773-8a53-7fce7dd6a2cb tempest-ProjectMemberTests-322461420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.225s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:43 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-2cdb2739-1016-4773-8a53-7fce7dd6a2cb tempest-ProjectMemberTests-322461420 None] Create snapshot completed successfully Sep 04 16:07:43 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-a487f8cb-b793-4d5a-ae7d-bc5e3145b921 tempest-ProjectReaderTests-421961720 None] Created reservations ['52fc53f5-1c95-43ef-bb84-34fe133da250', '521ac480-0aa7-4423-8c73-d20db5745c71', '87cffd9a-6075-4f60-a776-50379de07132', '99e7a846-425c-4f91-9c75-29ac17ebac31'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a487f8cb-b793-4d5a-ae7d-bc5e3145b921 tempest-ProjectReaderTests-421961720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a487f8cb-b793-4d5a-ae7d-bc5e3145b921 tempest-ProjectReaderTests-421961720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a487f8cb-b793-4d5a-ae7d-bc5e3145b921 tempest-ProjectReaderTests-421961720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:43 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-a487f8cb-b793-4d5a-ae7d-bc5e3145b921 tempest-ProjectReaderTests-421961720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a487f8cb-b793-4d5a-ae7d-bc5e3145b921 tempest-ProjectReaderTests-421961720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:43 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a487f8cb-b793-4d5a-ae7d-bc5e3145b921 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:43 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:07:43 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:44 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a487f8cb-b793-4d5a-ae7d-bc5e3145b921 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.261s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-a487f8cb-b793-4d5a-ae7d-bc5e3145b921 tempest-ProjectReaderTests-421961720 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:07:44 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-a487f8cb-b793-4d5a-ae7d-bc5e3145b921 tempest-ProjectReaderTests-421961720 None] Deleted volume successfully. Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a487f8cb-b793-4d5a-ae7d-bc5e3145b921 tempest-ProjectReaderTests-421961720 None] Lock "cinder-f32a5d1d-03ea-41a6-b0ff-f93cc3e04a29-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Flow 'volume_create_manager' (b1ea0666-5054-4754-9b3d-99703de5b316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb1a0a3d-5c87-4893-a8d7-f279c79c89da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb1a0a3d-5c87-4893-a8d7-f279c79c89da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-531907037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a05c9ae-3bfa-482e-aed6-9b22f168f2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d109122bf84b415d9086c05a28136dc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:44Z,use_quota=True,user_id='ac8b6cb0ead44778a39bb00c297a9126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6665db-f856-48fb-93a5-6e75b7201836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6665db-f856-48fb-93a5-6e75b7201836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (453efeb4-5f10-42d2-9c55-549e88e7f481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (453efeb4-5f10-42d2-9c55-549e88e7f481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a05c9ae-3bfa-482e-aed6-9b22f168f2fe', 'volume_name': 'volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7e6f69-8aeb-46e3-b184-ba037f19a87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7e6f69-8aeb-46e3-b184-ba037f19a87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4108be6d-5060-46fa-a3b1-ff065263d4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:44 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Volume 5a05c9ae-3bfa-482e-aed6-9b22f168f2fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe', 'volume_size': 1} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-531907037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a05c9ae-3bfa-482e-aed6-9b22f168f2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d109122bf84b415d9086c05a28136dc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:44Z,use_quota=True,user_id='ac8b6cb0ead44778a39bb00c297a9126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Creating volume 5a05c9ae-3bfa-482e-aed6-9b22f168f2fe {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:07:44 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:44 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe 1073741824 Sep 04 16:07:44 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-72f106c5-43b7-4851-bd78-99f1bfcd0c15 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-4d93775d-12b7-4460-adb3-957480dcb3ce-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-72f106c5-43b7-4851-bd78-99f1bfcd0c15 tempest-ProjectMemberTests-322461420 None] Lock "cinder-4d93775d-12b7-4460-adb3-957480dcb3ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-72f106c5-43b7-4851-bd78-99f1bfcd0c15 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-quobyte-3e16f76d-5390-40c2-a0c6-d80ade51a020" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-72f106c5-43b7-4851-bd78-99f1bfcd0c15 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-3e16f76d-5390-40c2-a0c6-d80ade51a020" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-72f106c5-43b7-4851-bd78-99f1bfcd0c15 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-quobyte-4d93775d-12b7-4460-adb3-957480dcb3ce" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-72f106c5-43b7-4851-bd78-99f1bfcd0c15 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-4d93775d-12b7-4460-adb3-957480dcb3ce" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-72f106c5-43b7-4851-bd78-99f1bfcd0c15 tempest-ProjectMemberTests-322461420 None] Deleting offline snapshot 4d93775d-12b7-4460-adb3-957480dcb3ce of volume 3e16f76d-5390-40c2-a0c6-d80ade51a020 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-72f106c5-43b7-4851-bd78-99f1bfcd0c15 tempest-ProjectMemberTests-322461420 None] snapshot_file for this snap is: volume-3e16f76d-5390-40c2-a0c6-d80ade51a020.4d93775d-12b7-4460-adb3-957480dcb3ce {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d03afa5-6772-4b1d-889a-f673559bf2aa]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:44 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-72f106c5-43b7-4851-bd78-99f1bfcd0c15 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020.4d93775d-12b7-4460-adb3-957480dcb3ce {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:44 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020.4d93775d-12b7-4460-adb3-957480dcb3ce Sep 04 16:07:44 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:45 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe 1073741824" returned: 0 in 0.523s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:45 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe Sep 04 16:07:45 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:45 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-72f106c5-43b7-4851-bd78-99f1bfcd0c15 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020.4d93775d-12b7-4460-adb3-957480dcb3ce" returned: 0 in 0.422s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-72f106c5-43b7-4851-bd78-99f1bfcd0c15 tempest-ProjectMemberTests-322461420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e16f76d-5390-40c2-a0c6-d80ade51a020(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:07:45 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3880d2-6395-452b-b8d4-bd8b6dcfac0c]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-72f106c5-43b7-4851-bd78-99f1bfcd0c15 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:45 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020 Sep 04 16:07:45 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:45 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe" returned: 0 in 0.242s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:45 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:07:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4108be6d-5060-46fa-a3b1-ff065263d4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f996f1-fd14-4103-99c8-0dfddab692d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:45 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Volume volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe (5a05c9ae-3bfa-482e-aed6-9b22f168f2fe): created successfully Sep 04 16:07:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f996f1-fd14-4103-99c8-0dfddab692d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:45 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Flow 'volume_create_manager' (b1ea0666-5054-4754-9b3d-99703de5b316) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:45 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-9e04fa22-1e04-4d53-be7a-e511712c4139 tempest-ProjectReaderTests-421961720 None] Created volume successfully. Sep 04 16:07:45 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-72f106c5-43b7-4851-bd78-99f1bfcd0c15 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020" returned: 0 in 0.351s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-72f106c5-43b7-4851-bd78-99f1bfcd0c15 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020.4d93775d-12b7-4460-adb3-957480dcb3ce {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:45 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020.4d93775d-12b7-4460-adb3-957480dcb3ce Sep 04 16:07:45 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:45 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-72f106c5-43b7-4851-bd78-99f1bfcd0c15 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020.4d93775d-12b7-4460-adb3-957480dcb3ce" returned: 0 in 0.335s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:45 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-72f106c5-43b7-4851-bd78-99f1bfcd0c15 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020.4d93775d-12b7-4460-adb3-957480dcb3ce {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:45 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020.4d93775d-12b7-4460-adb3-957480dcb3ce Sep 04 16:07:45 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:46 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-72f106c5-43b7-4851-bd78-99f1bfcd0c15 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020.4d93775d-12b7-4460-adb3-957480dcb3ce" returned: 0 in 0.255s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:46 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-72f106c5-43b7-4851-bd78-99f1bfcd0c15 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-4d93775d-12b7-4460-adb3-957480dcb3ce" released by "_delete_snapshot" :: held 1.478s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:46 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-72f106c5-43b7-4851-bd78-99f1bfcd0c15 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-3e16f76d-5390-40c2-a0c6-d80ade51a020" released by "delete_snapshot" :: held 1.500s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:46 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-72f106c5-43b7-4851-bd78-99f1bfcd0c15 tempest-ProjectMemberTests-322461420 None] Created reservations ['828454e9-faa4-49e7-83ca-734c93ed845d', 'd6c9a959-e593-46fd-8b9b-e145a31565ff', 'fb2165ac-d2cf-4f2a-ae8d-02a7bbe77cd3', '0da6ced3-be8a-4199-8707-fe53061b9fff'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:46 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-72f106c5-43b7-4851-bd78-99f1bfcd0c15 tempest-ProjectMemberTests-322461420 None] Delete snapshot completed successfully. Sep 04 16:07:46 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-72f106c5-43b7-4851-bd78-99f1bfcd0c15 tempest-ProjectMemberTests-322461420 None] Lock "cinder-4d93775d-12b7-4460-adb3-957480dcb3ce-delete_snapshot" released by "delete_snapshot" :: held 1.649s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:46 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5eed0425-3732-4635-b713-212733505db5 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-3e16f76d-5390-40c2-a0c6-d80ade51a020-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:46 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5eed0425-3732-4635-b713-212733505db5 tempest-ProjectMemberTests-322461420 None] Lock "cinder-3e16f76d-5390-40c2-a0c6-d80ade51a020-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:46 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5eed0425-3732-4635-b713-212733505db5 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-quobyte-3e16f76d-5390-40c2-a0c6-d80ade51a020" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:46 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5eed0425-3732-4635-b713-212733505db5 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-3e16f76d-5390-40c2-a0c6-d80ade51a020" acquired by "delete_volume" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:46 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ca3a75-71bf-4b36-a82d-a41c64eba16c]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:46 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5eed0425-3732-4635-b713-212733505db5 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1f828737-99d1-4af5-9007-0981c430f717 tempest-ProjectReaderTests-421961720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1f828737-99d1-4af5-9007-0981c430f717 tempest-ProjectReaderTests-421961720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:47 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-1f828737-99d1-4af5-9007-0981c430f717 tempest-ProjectReaderTests-421961720 None] Creating offline snapshot e885f65e-cc81-485a-8e3f-c6ceba04f100 of volume 5a05c9ae-3bfa-482e-aed6-9b22f168f2fe {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:07:47 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b58857-e78f-464c-a290-cc88332c1ec5]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1f828737-99d1-4af5-9007-0981c430f717 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:47 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020 Sep 04 16:07:47 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:47 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe Sep 04 16:07:47 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:47 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5eed0425-3732-4635-b713-212733505db5 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020" returned: 0 in 0.368s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5eed0425-3732-4635-b713-212733505db5 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:47 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020 Sep 04 16:07:47 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:47 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1f828737-99d1-4af5-9007-0981c430f717 tempest-ProjectReaderTests-421961720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe" returned: 0 in 0.378s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1f828737-99d1-4af5-9007-0981c430f717 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe.e885f65e-cc81-485a-8e3f-c6ceba04f100 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:47 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe.e885f65e-cc81-485a-8e3f-c6ceba04f100 1G Sep 04 16:07:47 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:47 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5eed0425-3732-4635-b713-212733505db5 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3e16f76d-5390-40c2-a0c6-d80ade51a020" returned: 0 in 0.247s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:47 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5eed0425-3732-4635-b713-212733505db5 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-3e16f76d-5390-40c2-a0c6-d80ade51a020" released by "delete_volume" :: held 0.695s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:47 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-5eed0425-3732-4635-b713-212733505db5 tempest-ProjectMemberTests-322461420 None] Created reservations ['663dd995-8108-4ae1-a987-ff4514272b67', 'b19e3950-e78c-4014-bf92-f0ee0e1c40a3', '025167ae-8fe6-4362-80ea-1cc7f7eda803', '6cd7c526-95b1-4bd0-8582-234828f5e3be'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5eed0425-3732-4635-b713-212733505db5 tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5eed0425-3732-4635-b713-212733505db5 tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:47 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-5eed0425-3732-4635-b713-212733505db5 tempest-ProjectMemberTests-322461420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:47 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-5eed0425-3732-4635-b713-212733505db5 tempest-ProjectMemberTests-322461420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-5eed0425-3732-4635-b713-212733505db5 tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5eed0425-3732-4635-b713-212733505db5 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:47 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:07:47 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:47 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1f828737-99d1-4af5-9007-0981c430f717 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe.e885f65e-cc81-485a-8e3f-c6ceba04f100 1G" returned: 0 in 0.432s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:47 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1f828737-99d1-4af5-9007-0981c430f717 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe.e885f65e-cc81-485a-8e3f-c6ceba04f100 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:47 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe.e885f65e-cc81-485a-8e3f-c6ceba04f100 Sep 04 16:07:47 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:48 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-5eed0425-3732-4635-b713-212733505db5 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.295s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:48 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-5eed0425-3732-4635-b713-212733505db5 tempest-ProjectMemberTests-322461420 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:07:48 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-5eed0425-3732-4635-b713-212733505db5 tempest-ProjectMemberTests-322461420 None] Deleted volume successfully. Sep 04 16:07:48 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-5eed0425-3732-4635-b713-212733505db5 tempest-ProjectMemberTests-322461420 None] Lock "cinder-3e16f76d-5390-40c2-a0c6-d80ade51a020-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:48 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1f828737-99d1-4af5-9007-0981c430f717 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe.e885f65e-cc81-485a-8e3f-c6ceba04f100" returned: 0 in 0.335s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:48 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-1f828737-99d1-4af5-9007-0981c430f717 tempest-ProjectReaderTests-421961720 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe.e885f65e-cc81-485a-8e3f-c6ceba04f100 is being set with open permissions: ugo+rw Sep 04 16:07:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1f828737-99d1-4af5-9007-0981c430f717 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe.e885f65e-cc81-485a-8e3f-c6ceba04f100 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:48 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe.e885f65e-cc81-485a-8e3f-c6ceba04f100 Sep 04 16:07:48 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:48 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1f828737-99d1-4af5-9007-0981c430f717 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe.e885f65e-cc81-485a-8e3f-c6ceba04f100" returned: 0 in 0.328s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1f828737-99d1-4af5-9007-0981c430f717 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:48 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe.info Sep 04 16:07:48 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:48 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:07:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Flow 'volume_create_manager' (1ba8a22f-bfcb-4030-8cf4-906120a40358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dba560b-f873-45f6-883f-57b29dd28dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dba560b-f873-45f6-883f-57b29dd28dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-4296233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae5c9b6-74ed-4145-8ed2-2e27fbf76772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67dc993fc9ce4300852a9f87ee1ded6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:49Z,use_quota=True,user_id='862f7e66540c4c5baa32a03cb34b0c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2e951f-0cef-49e1-ad98-4cd2909f9838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2e951f-0cef-49e1-ad98-4cd2909f9838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9e403d-d6b5-4991-89ad-923060df11ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9e403d-d6b5-4991-89ad-923060df11ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bae5c9b6-74ed-4145-8ed2-2e27fbf76772', 'volume_name': 'volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8f4e82-5b64-4b74-a9b1-23a5ab6caa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8f4e82-5b64-4b74-a9b1-23a5ab6caa82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:48 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee4c953b-98a9-4c1c-aa62-1c9d4fc31876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:48 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Volume bae5c9b6-74ed-4145-8ed2-2e27fbf76772: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772', 'volume_size': 1} Sep 04 16:07:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:48 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1f828737-99d1-4af5-9007-0981c430f717 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe.info" returned: 0 in 0.299s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:48 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-1f828737-99d1-4af5-9007-0981c430f717 tempest-ProjectReaderTests-421961720 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe.info is being set with open permissions: ugo+rw Sep 04 16:07:48 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1f828737-99d1-4af5-9007-0981c430f717 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:48 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe.info Sep 04 16:07:48 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:49 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1f828737-99d1-4af5-9007-0981c430f717 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe.info" returned: 0 in 0.231s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1f828737-99d1-4af5-9007-0981c430f717 tempest-ProjectReaderTests-421961720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.088s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.325s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-4296233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae5c9b6-74ed-4145-8ed2-2e27fbf76772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67dc993fc9ce4300852a9f87ee1ded6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:49Z,use_quota=True,user_id='862f7e66540c4c5baa32a03cb34b0c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Creating volume bae5c9b6-74ed-4145-8ed2-2e27fbf76772 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:07:49 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:49 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772 1073741824 Sep 04 16:07:49 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:49 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-1f828737-99d1-4af5-9007-0981c430f717 tempest-ProjectReaderTests-421961720 None] Create snapshot completed successfully Sep 04 16:07:49 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772 1073741824" returned: 0 in 0.407s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:49 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772 Sep 04 16:07:49 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:49 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772" returned: 0 in 0.243s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee4c953b-98a9-4c1c-aa62-1c9d4fc31876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e4d508-be30-4aea-9de7-24d247e77e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:49 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Volume volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772 (bae5c9b6-74ed-4145-8ed2-2e27fbf76772): created successfully Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e4d508-be30-4aea-9de7-24d247e77e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Flow 'volume_create_manager' (1ba8a22f-bfcb-4030-8cf4-906120a40358) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:49 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-b55cd2b8-561f-4e06-8582-100bef88440d tempest-ProjectMemberTests-322461420 None] Created volume successfully. Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-971e2a05-f462-4141-8a72-d84931abf635 tempest-ProjectReaderTests-421961720 None] Acquiring lock "cinder-e885f65e-cc81-485a-8e3f-c6ceba04f100-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-971e2a05-f462-4141-8a72-d84931abf635 tempest-ProjectReaderTests-421961720 None] Lock "cinder-e885f65e-cc81-485a-8e3f-c6ceba04f100-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-971e2a05-f462-4141-8a72-d84931abf635 tempest-ProjectReaderTests-421961720 None] Acquiring lock "cinder-quobyte-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-971e2a05-f462-4141-8a72-d84931abf635 tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-971e2a05-f462-4141-8a72-d84931abf635 tempest-ProjectReaderTests-421961720 None] Acquiring lock "cinder-quobyte-e885f65e-cc81-485a-8e3f-c6ceba04f100" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-971e2a05-f462-4141-8a72-d84931abf635 tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-e885f65e-cc81-485a-8e3f-c6ceba04f100" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:49 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-971e2a05-f462-4141-8a72-d84931abf635 tempest-ProjectReaderTests-421961720 None] Deleting offline snapshot e885f65e-cc81-485a-8e3f-c6ceba04f100 of volume 5a05c9ae-3bfa-482e-aed6-9b22f168f2fe {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:07:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-971e2a05-f462-4141-8a72-d84931abf635 tempest-ProjectReaderTests-421961720 None] snapshot_file for this snap is: volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe.e885f65e-cc81-485a-8e3f-c6ceba04f100 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:07:50 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41216ba-0597-4ca1-b276-4e769a30fd6c]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-971e2a05-f462-4141-8a72-d84931abf635 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe.e885f65e-cc81-485a-8e3f-c6ceba04f100 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:50 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe.e885f65e-cc81-485a-8e3f-c6ceba04f100 Sep 04 16:07:50 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:50 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-971e2a05-f462-4141-8a72-d84931abf635 tempest-ProjectReaderTests-421961720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe.e885f65e-cc81-485a-8e3f-c6ceba04f100" returned: 0 in 0.386s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-971e2a05-f462-4141-8a72-d84931abf635 tempest-ProjectReaderTests-421961720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:07:50 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[742a498c-203f-4ddf-a518-b039f594bbb7]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-971e2a05-f462-4141-8a72-d84931abf635 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:50 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe Sep 04 16:07:50 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:50 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-971e2a05-f462-4141-8a72-d84931abf635 tempest-ProjectReaderTests-421961720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe" returned: 0 in 0.379s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-971e2a05-f462-4141-8a72-d84931abf635 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe.e885f65e-cc81-485a-8e3f-c6ceba04f100 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:50 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe.e885f65e-cc81-485a-8e3f-c6ceba04f100 Sep 04 16:07:50 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3d5e74c2-f2ac-4d15-9780-30677d9ad4f8 tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3d5e74c2-f2ac-4d15-9780-30677d9ad4f8 tempest-ProjectMemberTests-322461420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:50 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-3d5e74c2-f2ac-4d15-9780-30677d9ad4f8 tempest-ProjectMemberTests-322461420 None] Creating offline snapshot 4ef08110-9d6f-4675-8a13-dde509469073 of volume bae5c9b6-74ed-4145-8ed2-2e27fbf76772 {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:07:50 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd728449-1b6e-436c-a191-90dde2d0ab36]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:50 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3d5e74c2-f2ac-4d15-9780-30677d9ad4f8 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:51 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772 Sep 04 16:07:51 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:51 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-971e2a05-f462-4141-8a72-d84931abf635 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe.e885f65e-cc81-485a-8e3f-c6ceba04f100" returned: 0 in 0.446s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-971e2a05-f462-4141-8a72-d84931abf635 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe.e885f65e-cc81-485a-8e3f-c6ceba04f100 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:51 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe.e885f65e-cc81-485a-8e3f-c6ceba04f100 Sep 04 16:07:51 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:51 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3d5e74c2-f2ac-4d15-9780-30677d9ad4f8 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772" returned: 0 in 0.425s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3d5e74c2-f2ac-4d15-9780-30677d9ad4f8 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772.4ef08110-9d6f-4675-8a13-dde509469073 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:51 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772.4ef08110-9d6f-4675-8a13-dde509469073 1G Sep 04 16:07:51 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:51 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-971e2a05-f462-4141-8a72-d84931abf635 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe.e885f65e-cc81-485a-8e3f-c6ceba04f100" returned: 0 in 0.295s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:51 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-971e2a05-f462-4141-8a72-d84931abf635 tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-e885f65e-cc81-485a-8e3f-c6ceba04f100" released by "_delete_snapshot" :: held 1.621s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:51 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-971e2a05-f462-4141-8a72-d84931abf635 tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe" released by "delete_snapshot" :: held 1.652s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:51 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-971e2a05-f462-4141-8a72-d84931abf635 tempest-ProjectReaderTests-421961720 None] Created reservations ['fd81d710-2884-4aa5-992b-45cc34435448', 'bc3d2863-55fe-4507-ad89-f42f044ab32d', '93be0e0c-04c6-49af-9fb5-2be3c463b9d6', '98320ba2-71ab-4609-9cf9-e069e0573e4f'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:51 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-971e2a05-f462-4141-8a72-d84931abf635 tempest-ProjectReaderTests-421961720 None] Delete snapshot completed successfully. Sep 04 16:07:51 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-971e2a05-f462-4141-8a72-d84931abf635 tempest-ProjectReaderTests-421961720 None] Lock "cinder-e885f65e-cc81-485a-8e3f-c6ceba04f100-delete_snapshot" released by "delete_snapshot" :: held 1.808s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:51 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3d5e74c2-f2ac-4d15-9780-30677d9ad4f8 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772.4ef08110-9d6f-4675-8a13-dde509469073 1G" returned: 0 in 0.478s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:51 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3d5e74c2-f2ac-4d15-9780-30677d9ad4f8 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772.4ef08110-9d6f-4675-8a13-dde509469073 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:51 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772.4ef08110-9d6f-4675-8a13-dde509469073 Sep 04 16:07:51 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e0333f98-587f-40af-89f5-0864ab55fcf7 tempest-ProjectReaderTests-421961720 None] Acquiring lock "cinder-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e0333f98-587f-40af-89f5-0864ab55fcf7 tempest-ProjectReaderTests-421961720 None] Lock "cinder-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e0333f98-587f-40af-89f5-0864ab55fcf7 tempest-ProjectReaderTests-421961720 None] Acquiring lock "cinder-quobyte-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e0333f98-587f-40af-89f5-0864ab55fcf7 tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe" acquired by "delete_volume" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:52 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3d5e74c2-f2ac-4d15-9780-30677d9ad4f8 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772.4ef08110-9d6f-4675-8a13-dde509469073" returned: 0 in 0.362s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:52 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-3d5e74c2-f2ac-4d15-9780-30677d9ad4f8 tempest-ProjectMemberTests-322461420 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772.4ef08110-9d6f-4675-8a13-dde509469073 is being set with open permissions: ugo+rw Sep 04 16:07:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3d5e74c2-f2ac-4d15-9780-30677d9ad4f8 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772.4ef08110-9d6f-4675-8a13-dde509469073 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:52 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[6482658d-cd83-4878-b59e-3bd56f321611]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e0333f98-587f-40af-89f5-0864ab55fcf7 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:52 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772.4ef08110-9d6f-4675-8a13-dde509469073 Sep 04 16:07:52 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:52 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe Sep 04 16:07:52 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:52 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3d5e74c2-f2ac-4d15-9780-30677d9ad4f8 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772.4ef08110-9d6f-4675-8a13-dde509469073" returned: 0 in 0.242s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3d5e74c2-f2ac-4d15-9780-30677d9ad4f8 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:52 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772.info Sep 04 16:07:52 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:52 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e0333f98-587f-40af-89f5-0864ab55fcf7 tempest-ProjectReaderTests-421961720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe" returned: 0 in 0.380s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e0333f98-587f-40af-89f5-0864ab55fcf7 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:52 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe Sep 04 16:07:52 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:52 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3d5e74c2-f2ac-4d15-9780-30677d9ad4f8 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772.info" returned: 0 in 0.247s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:52 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-3d5e74c2-f2ac-4d15-9780-30677d9ad4f8 tempest-ProjectMemberTests-322461420 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772.info is being set with open permissions: ugo+rw Sep 04 16:07:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3d5e74c2-f2ac-4d15-9780-30677d9ad4f8 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:52 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772.info Sep 04 16:07:52 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:52 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e0333f98-587f-40af-89f5-0864ab55fcf7 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe" returned: 0 in 0.252s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:52 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e0333f98-587f-40af-89f5-0864ab55fcf7 tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe" released by "delete_volume" :: held 0.711s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:52 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-e0333f98-587f-40af-89f5-0864ab55fcf7 tempest-ProjectReaderTests-421961720 None] Created reservations ['f1298301-ba5d-43a5-b681-a7757fcb1184', 'b016bc38-3c4c-47c9-b324-1bd32f45ab6a', '26f2467c-323c-4578-a588-b72427fbdaeb', 'e0bae038-1d58-4d72-839c-9fd872d90c62'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:52 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:52 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3d5e74c2-f2ac-4d15-9780-30677d9ad4f8 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772.info" returned: 0 in 0.239s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3d5e74c2-f2ac-4d15-9780-30677d9ad4f8 tempest-ProjectMemberTests-322461420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.094s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:53 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-3d5e74c2-f2ac-4d15-9780-30677d9ad4f8 tempest-ProjectMemberTests-322461420 None] Create snapshot completed successfully Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e0333f98-587f-40af-89f5-0864ab55fcf7 tempest-ProjectReaderTests-421961720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e0333f98-587f-40af-89f5-0864ab55fcf7 tempest-ProjectReaderTests-421961720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e0333f98-587f-40af-89f5-0864ab55fcf7 tempest-ProjectReaderTests-421961720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-e0333f98-587f-40af-89f5-0864ab55fcf7 tempest-ProjectReaderTests-421961720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e0333f98-587f-40af-89f5-0864ab55fcf7 tempest-ProjectReaderTests-421961720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e0333f98-587f-40af-89f5-0864ab55fcf7 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:53 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:07:53 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:53 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e0333f98-587f-40af-89f5-0864ab55fcf7 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.239s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-e0333f98-587f-40af-89f5-0864ab55fcf7 tempest-ProjectReaderTests-421961720 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:07:53 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-e0333f98-587f-40af-89f5-0864ab55fcf7 tempest-ProjectReaderTests-421961720 None] Deleted volume successfully. Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-e0333f98-587f-40af-89f5-0864ab55fcf7 tempest-ProjectReaderTests-421961720 None] Lock "cinder-5a05c9ae-3bfa-482e-aed6-9b22f168f2fe-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Flow 'volume_create_manager' (20d08029-8874-41a7-825b-4a330e7edb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd19cb58-e5a1-4a8a-9eb6-f424c74a7165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd19cb58-e5a1-4a8a-9eb6-f424c74a7165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1809235345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ea60a1-7d54-4239-a779-b4c557ced2fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d109122bf84b415d9086c05a28136dc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:54Z,use_quota=True,user_id='ac8b6cb0ead44778a39bb00c297a9126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c48a80a0-8ab5-4866-96d8-43520e4babf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c48a80a0-8ab5-4866-96d8-43520e4babf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcdf5164-3ae2-47f7-ad5b-650aa5a1c0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcdf5164-3ae2-47f7-ad5b-650aa5a1c0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6ea60a1-7d54-4239-a779-b4c557ced2fc', 'volume_name': 'volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3a2d16f-5033-4ad7-9ab7-c07a63fb640a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3a2d16f-5033-4ad7-9ab7-c07a63fb640a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b85cc0b-16c2-4750-888a-936d9116acb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:53 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Volume f6ea60a1-7d54-4239-a779-b4c557ced2fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc', 'volume_size': 1} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1809235345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ea60a1-7d54-4239-a779-b4c557ced2fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d109122bf84b415d9086c05a28136dc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:54Z,use_quota=True,user_id='ac8b6cb0ead44778a39bb00c297a9126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Creating volume f6ea60a1-7d54-4239-a779-b4c557ced2fc {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:07:53 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:07:53 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:53 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc 1073741824 Sep 04 16:07:53 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-14fb9dfc-0867-4868-a3e0-c7e39b5647c5 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-4ef08110-9d6f-4675-8a13-dde509469073-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-14fb9dfc-0867-4868-a3e0-c7e39b5647c5 tempest-ProjectMemberTests-322461420 None] Lock "cinder-4ef08110-9d6f-4675-8a13-dde509469073-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-14fb9dfc-0867-4868-a3e0-c7e39b5647c5 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-quobyte-bae5c9b6-74ed-4145-8ed2-2e27fbf76772" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-14fb9dfc-0867-4868-a3e0-c7e39b5647c5 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-bae5c9b6-74ed-4145-8ed2-2e27fbf76772" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-14fb9dfc-0867-4868-a3e0-c7e39b5647c5 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-quobyte-4ef08110-9d6f-4675-8a13-dde509469073" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-14fb9dfc-0867-4868-a3e0-c7e39b5647c5 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-4ef08110-9d6f-4675-8a13-dde509469073" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-14fb9dfc-0867-4868-a3e0-c7e39b5647c5 tempest-ProjectMemberTests-322461420 None] Deleting offline snapshot 4ef08110-9d6f-4675-8a13-dde509469073 of volume bae5c9b6-74ed-4145-8ed2-2e27fbf76772 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-14fb9dfc-0867-4868-a3e0-c7e39b5647c5 tempest-ProjectMemberTests-322461420 None] snapshot_file for this snap is: volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772.4ef08110-9d6f-4675-8a13-dde509469073 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[88259b86-63d3-4783-b323-048da38027c1]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-14fb9dfc-0867-4868-a3e0-c7e39b5647c5 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772.4ef08110-9d6f-4675-8a13-dde509469073 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:54 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc 1073741824" returned: 0 in 0.452s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:54 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772.4ef08110-9d6f-4675-8a13-dde509469073 Sep 04 16:07:54 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:54 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc Sep 04 16:07:54 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:54 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc" returned: 0 in 0.237s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:54 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b85cc0b-16c2-4750-888a-936d9116acb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e313296-5d4c-4397-b506-bdbe94905909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-14fb9dfc-0867-4868-a3e0-c7e39b5647c5 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772.4ef08110-9d6f-4675-8a13-dde509469073" returned: 0 in 0.395s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-14fb9dfc-0867-4868-a3e0-c7e39b5647c5 tempest-ProjectMemberTests-322461420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:07:54 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Volume volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc (f6ea60a1-7d54-4239-a779-b4c557ced2fc): created successfully Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e313296-5d4c-4397-b506-bdbe94905909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Flow 'volume_create_manager' (20d08029-8874-41a7-825b-4a330e7edb15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04106c9-46c9-40ee-8efd-12ac1337faa6]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-14fb9dfc-0867-4868-a3e0-c7e39b5647c5 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:54 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-74a05387-5786-4882-84ce-264a5cb63c2b tempest-ProjectReaderTests-421961720 None] Created volume successfully. Sep 04 16:07:54 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772 Sep 04 16:07:54 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7c661554-a393-482f-af50-2f15f5919051 tempest-ProjectReaderTests-421961720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7c661554-a393-482f-af50-2f15f5919051 tempest-ProjectReaderTests-421961720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-7c661554-a393-482f-af50-2f15f5919051 tempest-ProjectReaderTests-421961720 None] Creating offline snapshot cab45f05-15fd-4fab-82e6-fbec800869d5 of volume f6ea60a1-7d54-4239-a779-b4c557ced2fc {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb0fe68-a034-4c47-bf64-b549737559a8]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7c661554-a393-482f-af50-2f15f5919051 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:54 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-14fb9dfc-0867-4868-a3e0-c7e39b5647c5 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772" returned: 0 in 0.371s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:54 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-14fb9dfc-0867-4868-a3e0-c7e39b5647c5 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772.4ef08110-9d6f-4675-8a13-dde509469073 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:55 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772.4ef08110-9d6f-4675-8a13-dde509469073 Sep 04 16:07:55 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:55 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc Sep 04 16:07:55 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:55 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7c661554-a393-482f-af50-2f15f5919051 tempest-ProjectReaderTests-421961720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc" returned: 0 in 0.392s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7c661554-a393-482f-af50-2f15f5919051 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc.cab45f05-15fd-4fab-82e6-fbec800869d5 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:55 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-14fb9dfc-0867-4868-a3e0-c7e39b5647c5 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772.4ef08110-9d6f-4675-8a13-dde509469073" returned: 0 in 0.382s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-14fb9dfc-0867-4868-a3e0-c7e39b5647c5 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772.4ef08110-9d6f-4675-8a13-dde509469073 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:55 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc.cab45f05-15fd-4fab-82e6-fbec800869d5 1G Sep 04 16:07:55 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:55 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772.4ef08110-9d6f-4675-8a13-dde509469073 Sep 04 16:07:55 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:55 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-14fb9dfc-0867-4868-a3e0-c7e39b5647c5 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772.4ef08110-9d6f-4675-8a13-dde509469073" returned: 0 in 0.245s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-14fb9dfc-0867-4868-a3e0-c7e39b5647c5 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-4ef08110-9d6f-4675-8a13-dde509469073" released by "_delete_snapshot" :: held 1.496s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-14fb9dfc-0867-4868-a3e0-c7e39b5647c5 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-bae5c9b6-74ed-4145-8ed2-2e27fbf76772" released by "delete_snapshot" :: held 1.525s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:55 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-14fb9dfc-0867-4868-a3e0-c7e39b5647c5 tempest-ProjectMemberTests-322461420 None] Created reservations ['99cf7a61-6f54-41fa-ab43-67200519f3e7', '817171c6-37b7-4f91-bb88-a8788a38d84b', 'ba986811-9a7e-4a8c-a4bc-492b0cd27426', '605f0b92-adeb-4b84-81f0-8c04e2598ec1'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:55 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7c661554-a393-482f-af50-2f15f5919051 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc.cab45f05-15fd-4fab-82e6-fbec800869d5 1G" returned: 0 in 0.427s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:55 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7c661554-a393-482f-af50-2f15f5919051 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc.cab45f05-15fd-4fab-82e6-fbec800869d5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:55 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-14fb9dfc-0867-4868-a3e0-c7e39b5647c5 tempest-ProjectMemberTests-322461420 None] Delete snapshot completed successfully. Sep 04 16:07:55 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-14fb9dfc-0867-4868-a3e0-c7e39b5647c5 tempest-ProjectMemberTests-322461420 None] Lock "cinder-4ef08110-9d6f-4675-8a13-dde509469073-delete_snapshot" released by "delete_snapshot" :: held 1.699s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:55 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc.cab45f05-15fd-4fab-82e6-fbec800869d5 Sep 04 16:07:55 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:56 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7c661554-a393-482f-af50-2f15f5919051 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc.cab45f05-15fd-4fab-82e6-fbec800869d5" returned: 0 in 0.287s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:56 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-7c661554-a393-482f-af50-2f15f5919051 tempest-ProjectReaderTests-421961720 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc.cab45f05-15fd-4fab-82e6-fbec800869d5 is being set with open permissions: ugo+rw Sep 04 16:07:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7c661554-a393-482f-af50-2f15f5919051 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc.cab45f05-15fd-4fab-82e6-fbec800869d5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:56 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc.cab45f05-15fd-4fab-82e6-fbec800869d5 Sep 04 16:07:56 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3b632342-18aa-493d-817a-24a507751da3 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-bae5c9b6-74ed-4145-8ed2-2e27fbf76772-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3b632342-18aa-493d-817a-24a507751da3 tempest-ProjectMemberTests-322461420 None] Lock "cinder-bae5c9b6-74ed-4145-8ed2-2e27fbf76772-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:56 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3b632342-18aa-493d-817a-24a507751da3 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-quobyte-bae5c9b6-74ed-4145-8ed2-2e27fbf76772" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7c661554-a393-482f-af50-2f15f5919051 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc.cab45f05-15fd-4fab-82e6-fbec800869d5" returned: 0 in 0.276s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:56 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3b632342-18aa-493d-817a-24a507751da3 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-bae5c9b6-74ed-4145-8ed2-2e27fbf76772" acquired by "delete_volume" :: waited 0.020s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7c661554-a393-482f-af50-2f15f5919051 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:56 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[582a744b-3dd7-43da-bb7a-9f7dc2f632c7]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3b632342-18aa-493d-817a-24a507751da3 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:56 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc.info Sep 04 16:07:56 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:56 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772 Sep 04 16:07:56 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:56 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7c661554-a393-482f-af50-2f15f5919051 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc.info" returned: 0 in 0.262s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:56 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-7c661554-a393-482f-af50-2f15f5919051 tempest-ProjectReaderTests-421961720 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc.info is being set with open permissions: ugo+rw Sep 04 16:07:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7c661554-a393-482f-af50-2f15f5919051 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:56 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc.info Sep 04 16:07:56 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:56 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3b632342-18aa-493d-817a-24a507751da3 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772" returned: 0 in 0.362s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3b632342-18aa-493d-817a-24a507751da3 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:56 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772 Sep 04 16:07:56 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:56 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7c661554-a393-482f-af50-2f15f5919051 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc.info" returned: 0 in 0.252s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:56 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7c661554-a393-482f-af50-2f15f5919051 tempest-ProjectReaderTests-421961720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:56 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-7c661554-a393-482f-af50-2f15f5919051 tempest-ProjectReaderTests-421961720 None] Create snapshot completed successfully Sep 04 16:07:57 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3b632342-18aa-493d-817a-24a507751da3 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-bae5c9b6-74ed-4145-8ed2-2e27fbf76772" returned: 0 in 0.252s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3b632342-18aa-493d-817a-24a507751da3 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-bae5c9b6-74ed-4145-8ed2-2e27fbf76772" released by "delete_volume" :: held 0.686s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-3b632342-18aa-493d-817a-24a507751da3 tempest-ProjectMemberTests-322461420 None] Created reservations ['bcb67e70-ee5a-4eb9-b8da-4862eb915bcf', '6d89089c-4dad-497c-a1b7-1e4ce7206214', 'd7baaace-ce60-4b32-a35f-805774625ab9', 'ecf945a6-65dd-4462-83e4-a1bd9ab91020'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3b632342-18aa-493d-817a-24a507751da3 tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3b632342-18aa-493d-817a-24a507751da3 tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3b632342-18aa-493d-817a-24a507751da3 tempest-ProjectMemberTests-322461420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3b632342-18aa-493d-817a-24a507751da3 tempest-ProjectMemberTests-322461420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3b632342-18aa-493d-817a-24a507751da3 tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3b632342-18aa-493d-817a-24a507751da3 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:57 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:07:57 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:57 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3b632342-18aa-493d-817a-24a507751da3 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.290s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-3b632342-18aa-493d-817a-24a507751da3 tempest-ProjectMemberTests-322461420 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:07:57 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-3b632342-18aa-493d-817a-24a507751da3 tempest-ProjectMemberTests-322461420 None] Deleted volume successfully. Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-3b632342-18aa-493d-817a-24a507751da3 tempest-ProjectMemberTests-322461420 None] Lock "cinder-bae5c9b6-74ed-4145-8ed2-2e27fbf76772-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Flow 'volume_create_manager' (0d8da39f-ebac-406c-9e66-6ac82ebb2198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f557fcc-15b3-48ab-a98f-4cec30c24b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f557fcc-15b3-48ab-a98f-4cec30c24b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-617480349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17c90044-ade1-4242-89de-824599d7b3e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67dc993fc9ce4300852a9f87ee1ded6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:58Z,use_quota=True,user_id='862f7e66540c4c5baa32a03cb34b0c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3323cc-6b17-4c8e-b36b-eda47892c97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3323cc-6b17-4c8e-b36b-eda47892c97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ff2821-78e8-4787-8cdb-d4f1e9a71bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ff2821-78e8-4787-8cdb-d4f1e9a71bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17c90044-ade1-4242-89de-824599d7b3e0', 'volume_name': 'volume-17c90044-ade1-4242-89de-824599d7b3e0', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa61415e-5482-4dc8-9996-8a1df5a10b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa61415e-5482-4dc8-9996-8a1df5a10b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf88f67-607b-4fc9-a0d1-40049c6c6636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:57 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Volume 17c90044-ade1-4242-89de-824599d7b3e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17c90044-ade1-4242-89de-824599d7b3e0', 'volume_size': 1} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-617480349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17c90044-ade1-4242-89de-824599d7b3e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67dc993fc9ce4300852a9f87ee1ded6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:07:58Z,use_quota=True,user_id='862f7e66540c4c5baa32a03cb34b0c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Creating volume 17c90044-ade1-4242-89de-824599d7b3e0 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:07:57 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:07:57 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:58 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0 1073741824 Sep 04 16:07:58 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:58 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-96e5546b-232c-4f87-8d69-dda7b042b5aa tempest-ProjectReaderTests-421961720 None] Acquiring lock "cinder-cab45f05-15fd-4fab-82e6-fbec800869d5-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:58 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-96e5546b-232c-4f87-8d69-dda7b042b5aa tempest-ProjectReaderTests-421961720 None] Lock "cinder-cab45f05-15fd-4fab-82e6-fbec800869d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:58 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-96e5546b-232c-4f87-8d69-dda7b042b5aa tempest-ProjectReaderTests-421961720 None] Acquiring lock "cinder-quobyte-f6ea60a1-7d54-4239-a779-b4c557ced2fc" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:58 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-96e5546b-232c-4f87-8d69-dda7b042b5aa tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-f6ea60a1-7d54-4239-a779-b4c557ced2fc" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:58 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-96e5546b-232c-4f87-8d69-dda7b042b5aa tempest-ProjectReaderTests-421961720 None] Acquiring lock "cinder-quobyte-cab45f05-15fd-4fab-82e6-fbec800869d5" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:07:58 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-96e5546b-232c-4f87-8d69-dda7b042b5aa tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-cab45f05-15fd-4fab-82e6-fbec800869d5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:07:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-96e5546b-232c-4f87-8d69-dda7b042b5aa tempest-ProjectReaderTests-421961720 None] Deleting offline snapshot cab45f05-15fd-4fab-82e6-fbec800869d5 of volume f6ea60a1-7d54-4239-a779-b4c557ced2fc {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:07:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-96e5546b-232c-4f87-8d69-dda7b042b5aa tempest-ProjectReaderTests-421961720 None] snapshot_file for this snap is: volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc.cab45f05-15fd-4fab-82e6-fbec800869d5 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:07:58 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[658097be-6a68-450b-8721-eca79e8381ab]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-96e5546b-232c-4f87-8d69-dda7b042b5aa tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc.cab45f05-15fd-4fab-82e6-fbec800869d5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:58 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc.cab45f05-15fd-4fab-82e6-fbec800869d5 Sep 04 16:07:58 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:58 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0 1073741824" returned: 0 in 0.447s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:58 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0 Sep 04 16:07:58 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:58 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-96e5546b-232c-4f87-8d69-dda7b042b5aa tempest-ProjectReaderTests-421961720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc.cab45f05-15fd-4fab-82e6-fbec800869d5" returned: 0 in 0.404s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-96e5546b-232c-4f87-8d69-dda7b042b5aa tempest-ProjectReaderTests-421961720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:07:58 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[1024705a-e710-44b7-a8e5-615d1618708e]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:07:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-96e5546b-232c-4f87-8d69-dda7b042b5aa tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:58 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc Sep 04 16:07:58 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:58 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0" returned: 0 in 0.295s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:58 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:07:58 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:07:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf88f67-607b-4fc9-a0d1-40049c6c6636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17c90044-ade1-4242-89de-824599d7b3e0', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808a99cf-9810-4173-856b-67978bdec944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:07:58 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Volume volume-17c90044-ade1-4242-89de-824599d7b3e0 (17c90044-ade1-4242-89de-824599d7b3e0): created successfully Sep 04 16:07:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808a99cf-9810-4173-856b-67978bdec944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:07:58 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Flow 'volume_create_manager' (0d8da39f-ebac-406c-9e66-6ac82ebb2198) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:07:58 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-769345c1-e9be-4bd3-a55e-d72df3855118 tempest-ProjectMemberTests-322461420 None] Created volume successfully. Sep 04 16:07:59 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-96e5546b-232c-4f87-8d69-dda7b042b5aa tempest-ProjectReaderTests-421961720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc" returned: 0 in 0.384s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-96e5546b-232c-4f87-8d69-dda7b042b5aa tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc.cab45f05-15fd-4fab-82e6-fbec800869d5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:59 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc.cab45f05-15fd-4fab-82e6-fbec800869d5 Sep 04 16:07:59 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:59 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-96e5546b-232c-4f87-8d69-dda7b042b5aa tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc.cab45f05-15fd-4fab-82e6-fbec800869d5" returned: 0 in 0.332s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-96e5546b-232c-4f87-8d69-dda7b042b5aa tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc.cab45f05-15fd-4fab-82e6-fbec800869d5 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:07:59 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc.cab45f05-15fd-4fab-82e6-fbec800869d5 Sep 04 16:07:59 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:07:59 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Sep 04 16:07:59 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-96e5546b-232c-4f87-8d69-dda7b042b5aa tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc.cab45f05-15fd-4fab-82e6-fbec800869d5" returned: 0 in 0.225s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:07:59 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-96e5546b-232c-4f87-8d69-dda7b042b5aa tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-cab45f05-15fd-4fab-82e6-fbec800869d5" released by "_delete_snapshot" :: held 1.442s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:59 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-96e5546b-232c-4f87-8d69-dda7b042b5aa tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-f6ea60a1-7d54-4239-a779-b4c557ced2fc" released by "delete_snapshot" :: held 1.469s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:07:59 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-96e5546b-232c-4f87-8d69-dda7b042b5aa tempest-ProjectReaderTests-421961720 None] Created reservations ['0ffaca0a-3208-4c53-9202-274972c48dfa', 'c511684b-a872-46d7-8b42-cd73234f363a', 'ffeb9065-425a-4ea4-a182-6739a072806d', '47c025f8-5615-49f0-aee1-05eda0d86d61'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:07:59 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-96e5546b-232c-4f87-8d69-dda7b042b5aa tempest-ProjectReaderTests-421961720 None] Delete snapshot completed successfully. Sep 04 16:07:59 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-96e5546b-232c-4f87-8d69-dda7b042b5aa tempest-ProjectReaderTests-421961720 None] Lock "cinder-cab45f05-15fd-4fab-82e6-fbec800869d5-delete_snapshot" released by "delete_snapshot" :: held 1.607s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-dc5eaf70-3c1c-4bb7-8c81-49b2aa4fe134 tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-dc5eaf70-3c1c-4bb7-8c81-49b2aa4fe134 tempest-ProjectMemberTests-322461420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:00 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-dc5eaf70-3c1c-4bb7-8c81-49b2aa4fe134 tempest-ProjectMemberTests-322461420 None] Creating offline snapshot 2fcb1380-59d8-45cf-bc52-16412ae71f5c of volume 17c90044-ade1-4242-89de-824599d7b3e0 {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:08:00 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[003d48f5-8d6f-4c13-a9ed-0c05b0c6f49b]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-dc5eaf70-3c1c-4bb7-8c81-49b2aa4fe134 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ff7830f4-8dcd-4e1a-985b-669b4bc96a68 tempest-ProjectReaderTests-421961720 None] Acquiring lock "cinder-f6ea60a1-7d54-4239-a779-b4c557ced2fc-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ff7830f4-8dcd-4e1a-985b-669b4bc96a68 tempest-ProjectReaderTests-421961720 None] Lock "cinder-f6ea60a1-7d54-4239-a779-b4c557ced2fc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:00 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0 Sep 04 16:08:00 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ff7830f4-8dcd-4e1a-985b-669b4bc96a68 tempest-ProjectReaderTests-421961720 None] Acquiring lock "cinder-quobyte-f6ea60a1-7d54-4239-a779-b4c557ced2fc" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:00 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ff7830f4-8dcd-4e1a-985b-669b4bc96a68 tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-f6ea60a1-7d54-4239-a779-b4c557ced2fc" acquired by "delete_volume" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:00 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[78275379-87fb-4646-8502-3185ce53ac95]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ff7830f4-8dcd-4e1a-985b-669b4bc96a68 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:00 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-dc5eaf70-3c1c-4bb7-8c81-49b2aa4fe134 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0" returned: 0 in 0.362s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-dc5eaf70-3c1c-4bb7-8c81-49b2aa4fe134 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0.2fcb1380-59d8-45cf-bc52-16412ae71f5c 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:00 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0.2fcb1380-59d8-45cf-bc52-16412ae71f5c 1G Sep 04 16:08:00 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:00 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc Sep 04 16:08:00 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:00 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ff7830f4-8dcd-4e1a-985b-669b4bc96a68 tempest-ProjectReaderTests-421961720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc" returned: 0 in 0.415s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ff7830f4-8dcd-4e1a-985b-669b4bc96a68 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:00 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc Sep 04 16:08:00 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:00 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-dc5eaf70-3c1c-4bb7-8c81-49b2aa4fe134 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0.2fcb1380-59d8-45cf-bc52-16412ae71f5c 1G" returned: 0 in 0.391s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:00 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-dc5eaf70-3c1c-4bb7-8c81-49b2aa4fe134 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17c90044-ade1-4242-89de-824599d7b3e0 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0.2fcb1380-59d8-45cf-bc52-16412ae71f5c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:00 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17c90044-ade1-4242-89de-824599d7b3e0 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0.2fcb1380-59d8-45cf-bc52-16412ae71f5c Sep 04 16:08:00 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:01 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ff7830f4-8dcd-4e1a-985b-669b4bc96a68 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f6ea60a1-7d54-4239-a779-b4c557ced2fc" returned: 0 in 0.323s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ff7830f4-8dcd-4e1a-985b-669b4bc96a68 tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-f6ea60a1-7d54-4239-a779-b4c557ced2fc" released by "delete_volume" :: held 0.803s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:01 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-ff7830f4-8dcd-4e1a-985b-669b4bc96a68 tempest-ProjectReaderTests-421961720 None] Created reservations ['fd5fa3e9-42d3-437c-8850-d9acf15e3489', '539917ef-810d-42d6-b351-ca64dad2011a', 'c06702e0-fcc6-4b92-b890-a8d9a920d40e', '58428ee6-0eba-418d-a3c6-fffbc9411a51'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:08:01 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-dc5eaf70-3c1c-4bb7-8c81-49b2aa4fe134 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17c90044-ade1-4242-89de-824599d7b3e0 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0.2fcb1380-59d8-45cf-bc52-16412ae71f5c" returned: 0 in 0.296s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:01 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-dc5eaf70-3c1c-4bb7-8c81-49b2aa4fe134 tempest-ProjectMemberTests-322461420 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0.2fcb1380-59d8-45cf-bc52-16412ae71f5c is being set with open permissions: ugo+rw Sep 04 16:08:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-dc5eaf70-3c1c-4bb7-8c81-49b2aa4fe134 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0.2fcb1380-59d8-45cf-bc52-16412ae71f5c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:01 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0.2fcb1380-59d8-45cf-bc52-16412ae71f5c Sep 04 16:08:01 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ff7830f4-8dcd-4e1a-985b-669b4bc96a68 tempest-ProjectReaderTests-421961720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ff7830f4-8dcd-4e1a-985b-669b4bc96a68 tempest-ProjectReaderTests-421961720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:01 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ff7830f4-8dcd-4e1a-985b-669b4bc96a68 tempest-ProjectReaderTests-421961720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:08:01 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ff7830f4-8dcd-4e1a-985b-669b4bc96a68 tempest-ProjectReaderTests-421961720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:08:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ff7830f4-8dcd-4e1a-985b-669b4bc96a68 tempest-ProjectReaderTests-421961720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ff7830f4-8dcd-4e1a-985b-669b4bc96a68 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:01 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:08:01 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:01 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-dc5eaf70-3c1c-4bb7-8c81-49b2aa4fe134 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0.2fcb1380-59d8-45cf-bc52-16412ae71f5c" returned: 0 in 0.248s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-dc5eaf70-3c1c-4bb7-8c81-49b2aa4fe134 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:01 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0.info Sep 04 16:08:01 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:01 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ff7830f4-8dcd-4e1a-985b-669b4bc96a68 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.283s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:01 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-ff7830f4-8dcd-4e1a-985b-669b4bc96a68 tempest-ProjectReaderTests-421961720 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:08:01 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-ff7830f4-8dcd-4e1a-985b-669b4bc96a68 tempest-ProjectReaderTests-421961720 None] Deleted volume successfully. Sep 04 16:08:01 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ff7830f4-8dcd-4e1a-985b-669b4bc96a68 tempest-ProjectReaderTests-421961720 None] Lock "cinder-f6ea60a1-7d54-4239-a779-b4c557ced2fc-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:01 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-dc5eaf70-3c1c-4bb7-8c81-49b2aa4fe134 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0.info" returned: 0 in 0.311s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:01 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-dc5eaf70-3c1c-4bb7-8c81-49b2aa4fe134 tempest-ProjectMemberTests-322461420 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0.info is being set with open permissions: ugo+rw Sep 04 16:08:01 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-dc5eaf70-3c1c-4bb7-8c81-49b2aa4fe134 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:01 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0.info Sep 04 16:08:01 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Flow 'volume_create_manager' (0ac00c56-fa75-4071-877a-bea93757aa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cdaef81-678a-4355-8bd1-a720ae2c9ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cdaef81-678a-4355-8bd1-a720ae2c9ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1563861588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=259527b5-2616-42b8-8d9c-5750d08f8f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d109122bf84b415d9086c05a28136dc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:02Z,use_quota=True,user_id='ac8b6cb0ead44778a39bb00c297a9126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1abc427d-08a7-46c6-9beb-e8522ed326ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1abc427d-08a7-46c6-9beb-e8522ed326ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947f6cbe-798c-46f8-b292-2be61ef2cb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947f6cbe-798c-46f8-b292-2be61ef2cb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '259527b5-2616-42b8-8d9c-5750d08f8f7c', 'volume_name': 'volume-259527b5-2616-42b8-8d9c-5750d08f8f7c', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2497fc4a-9b7b-4c8b-bd54-25aeeed7e095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2497fc4a-9b7b-4c8b-bd54-25aeeed7e095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5605f544-f7e3-4bb1-b7d0-71ab7ee85744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:02 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Volume 259527b5-2616-42b8-8d9c-5750d08f8f7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-259527b5-2616-42b8-8d9c-5750d08f8f7c', 'volume_size': 1} Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:02 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-dc5eaf70-3c1c-4bb7-8c81-49b2aa4fe134 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0.info" returned: 0 in 0.345s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-dc5eaf70-3c1c-4bb7-8c81-49b2aa4fe134 tempest-ProjectMemberTests-322461420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.050s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.060s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1563861588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=259527b5-2616-42b8-8d9c-5750d08f8f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d109122bf84b415d9086c05a28136dc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:02Z,use_quota=True,user_id='ac8b6cb0ead44778a39bb00c297a9126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Creating volume 259527b5-2616-42b8-8d9c-5750d08f8f7c {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:08:02 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:02 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c 1073741824 Sep 04 16:08:02 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:02 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-dc5eaf70-3c1c-4bb7-8c81-49b2aa4fe134 tempest-ProjectMemberTests-322461420 None] Create snapshot completed successfully Sep 04 16:08:02 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c 1073741824" returned: 0 in 0.450s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:02 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c Sep 04 16:08:02 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:02 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c" returned: 0 in 0.246s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5605f544-f7e3-4bb1-b7d0-71ab7ee85744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-259527b5-2616-42b8-8d9c-5750d08f8f7c', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04215330-540b-4f64-9790-e64c51d3632f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:02 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Volume volume-259527b5-2616-42b8-8d9c-5750d08f8f7c (259527b5-2616-42b8-8d9c-5750d08f8f7c): created successfully Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04215330-540b-4f64-9790-e64c51d3632f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:02 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Flow 'volume_create_manager' (0ac00c56-fa75-4071-877a-bea93757aa27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:08:03 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-1240fa85-3bf5-46a2-80c3-7f13bc27bbef tempest-ProjectReaderTests-421961720 None] Created volume successfully. Sep 04 16:08:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f9c14431-edf4-43a3-9b12-8d1a8e483a74 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-2fcb1380-59d8-45cf-bc52-16412ae71f5c-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f9c14431-edf4-43a3-9b12-8d1a8e483a74 tempest-ProjectMemberTests-322461420 None] Lock "cinder-2fcb1380-59d8-45cf-bc52-16412ae71f5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f9c14431-edf4-43a3-9b12-8d1a8e483a74 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-quobyte-17c90044-ade1-4242-89de-824599d7b3e0" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f9c14431-edf4-43a3-9b12-8d1a8e483a74 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-17c90044-ade1-4242-89de-824599d7b3e0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f9c14431-edf4-43a3-9b12-8d1a8e483a74 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-quobyte-2fcb1380-59d8-45cf-bc52-16412ae71f5c" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:03 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f9c14431-edf4-43a3-9b12-8d1a8e483a74 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-2fcb1380-59d8-45cf-bc52-16412ae71f5c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-f9c14431-edf4-43a3-9b12-8d1a8e483a74 tempest-ProjectMemberTests-322461420 None] Deleting offline snapshot 2fcb1380-59d8-45cf-bc52-16412ae71f5c of volume 17c90044-ade1-4242-89de-824599d7b3e0 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:08:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-f9c14431-edf4-43a3-9b12-8d1a8e483a74 tempest-ProjectMemberTests-322461420 None] snapshot_file for this snap is: volume-17c90044-ade1-4242-89de-824599d7b3e0.2fcb1380-59d8-45cf-bc52-16412ae71f5c {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:08:03 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c96ae51-41fa-46cc-b0ee-490eb8c6039b]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f9c14431-edf4-43a3-9b12-8d1a8e483a74 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0.2fcb1380-59d8-45cf-bc52-16412ae71f5c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:03 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0.2fcb1380-59d8-45cf-bc52-16412ae71f5c Sep 04 16:08:03 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:03 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f9c14431-edf4-43a3-9b12-8d1a8e483a74 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0.2fcb1380-59d8-45cf-bc52-16412ae71f5c" returned: 0 in 0.373s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:03 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-f9c14431-edf4-43a3-9b12-8d1a8e483a74 tempest-ProjectMemberTests-322461420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17c90044-ade1-4242-89de-824599d7b3e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:08:03 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7356bfa-5ab6-410a-ab3f-7d0892a8dded]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:03 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f9c14431-edf4-43a3-9b12-8d1a8e483a74 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:03 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0 Sep 04 16:08:03 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:04 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f9c14431-edf4-43a3-9b12-8d1a8e483a74 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0" returned: 0 in 0.388s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f9c14431-edf4-43a3-9b12-8d1a8e483a74 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0.2fcb1380-59d8-45cf-bc52-16412ae71f5c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:04 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0.2fcb1380-59d8-45cf-bc52-16412ae71f5c Sep 04 16:08:04 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a217e7b0-9874-45d3-9583-2b9e7be59308 tempest-ProjectReaderTests-421961720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a217e7b0-9874-45d3-9583-2b9e7be59308 tempest-ProjectReaderTests-421961720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:04 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-a217e7b0-9874-45d3-9583-2b9e7be59308 tempest-ProjectReaderTests-421961720 None] Creating offline snapshot 861f11ea-b63b-4c4a-8bee-563a033fe619 of volume 259527b5-2616-42b8-8d9c-5750d08f8f7c {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:08:04 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a147f90-f090-42b6-b109-a919c6d13dcf]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a217e7b0-9874-45d3-9583-2b9e7be59308 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:04 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c Sep 04 16:08:04 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:04 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f9c14431-edf4-43a3-9b12-8d1a8e483a74 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0.2fcb1380-59d8-45cf-bc52-16412ae71f5c" returned: 0 in 0.383s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f9c14431-edf4-43a3-9b12-8d1a8e483a74 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0.2fcb1380-59d8-45cf-bc52-16412ae71f5c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:04 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0.2fcb1380-59d8-45cf-bc52-16412ae71f5c Sep 04 16:08:04 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:04 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a217e7b0-9874-45d3-9583-2b9e7be59308 tempest-ProjectReaderTests-421961720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c" returned: 0 in 0.397s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a217e7b0-9874-45d3-9583-2b9e7be59308 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c.861f11ea-b63b-4c4a-8bee-563a033fe619 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:04 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c.861f11ea-b63b-4c4a-8bee-563a033fe619 1G Sep 04 16:08:04 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:04 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:04 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-f9c14431-edf4-43a3-9b12-8d1a8e483a74 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0.2fcb1380-59d8-45cf-bc52-16412ae71f5c" returned: 0 in 0.270s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:04 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f9c14431-edf4-43a3-9b12-8d1a8e483a74 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-2fcb1380-59d8-45cf-bc52-16412ae71f5c" released by "_delete_snapshot" :: held 1.511s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:04 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f9c14431-edf4-43a3-9b12-8d1a8e483a74 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-17c90044-ade1-4242-89de-824599d7b3e0" released by "delete_snapshot" :: held 1.537s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:04 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-f9c14431-edf4-43a3-9b12-8d1a8e483a74 tempest-ProjectMemberTests-322461420 None] Created reservations ['050216ff-1fbf-4abc-b41c-cd3b02bfa8ce', '6cf516d8-7360-4dcd-a0b4-b0b551f1cf51', 'd5dbd25c-8efb-453b-97f7-2089073a7ec9', '1611bcae-a88f-4fa4-9e5c-7ea5b4b2ad15'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:08:05 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-f9c14431-edf4-43a3-9b12-8d1a8e483a74 tempest-ProjectMemberTests-322461420 None] Delete snapshot completed successfully. Sep 04 16:08:05 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-f9c14431-edf4-43a3-9b12-8d1a8e483a74 tempest-ProjectMemberTests-322461420 None] Lock "cinder-2fcb1380-59d8-45cf-bc52-16412ae71f5c-delete_snapshot" released by "delete_snapshot" :: held 1.698s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:05 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a217e7b0-9874-45d3-9583-2b9e7be59308 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c.861f11ea-b63b-4c4a-8bee-563a033fe619 1G" returned: 0 in 0.425s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a217e7b0-9874-45d3-9583-2b9e7be59308 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-259527b5-2616-42b8-8d9c-5750d08f8f7c -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c.861f11ea-b63b-4c4a-8bee-563a033fe619 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:05 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-259527b5-2616-42b8-8d9c-5750d08f8f7c -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c.861f11ea-b63b-4c4a-8bee-563a033fe619 Sep 04 16:08:05 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:05 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ee653385-5ca6-44f5-93c1-9340a39723e1 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-17c90044-ade1-4242-89de-824599d7b3e0-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:05 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ee653385-5ca6-44f5-93c1-9340a39723e1 tempest-ProjectMemberTests-322461420 None] Lock "cinder-17c90044-ade1-4242-89de-824599d7b3e0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:05 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a217e7b0-9874-45d3-9583-2b9e7be59308 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-259527b5-2616-42b8-8d9c-5750d08f8f7c -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c.861f11ea-b63b-4c4a-8bee-563a033fe619" returned: 0 in 0.339s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:05 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-a217e7b0-9874-45d3-9583-2b9e7be59308 tempest-ProjectReaderTests-421961720 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c.861f11ea-b63b-4c4a-8bee-563a033fe619 is being set with open permissions: ugo+rw Sep 04 16:08:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a217e7b0-9874-45d3-9583-2b9e7be59308 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c.861f11ea-b63b-4c4a-8bee-563a033fe619 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:05 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c.861f11ea-b63b-4c4a-8bee-563a033fe619 Sep 04 16:08:05 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:05 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ee653385-5ca6-44f5-93c1-9340a39723e1 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-quobyte-17c90044-ade1-4242-89de-824599d7b3e0" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:05 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ee653385-5ca6-44f5-93c1-9340a39723e1 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-17c90044-ade1-4242-89de-824599d7b3e0" acquired by "delete_volume" :: waited 0.015s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:05 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75dcb20-3720-4508-bd6c-1e46af26b24b]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ee653385-5ca6-44f5-93c1-9340a39723e1 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:05 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0 Sep 04 16:08:05 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:05 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a217e7b0-9874-45d3-9583-2b9e7be59308 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c.861f11ea-b63b-4c4a-8bee-563a033fe619" returned: 0 in 0.257s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:05 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a217e7b0-9874-45d3-9583-2b9e7be59308 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:05 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c.info Sep 04 16:08:05 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:06 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ee653385-5ca6-44f5-93c1-9340a39723e1 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0" returned: 0 in 0.430s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ee653385-5ca6-44f5-93c1-9340a39723e1 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:06 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0 Sep 04 16:08:06 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:06 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a217e7b0-9874-45d3-9583-2b9e7be59308 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c.info" returned: 0 in 0.278s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:06 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-a217e7b0-9874-45d3-9583-2b9e7be59308 tempest-ProjectReaderTests-421961720 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c.info is being set with open permissions: ugo+rw Sep 04 16:08:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a217e7b0-9874-45d3-9583-2b9e7be59308 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:06 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c.info Sep 04 16:08:06 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:06 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ee653385-5ca6-44f5-93c1-9340a39723e1 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-17c90044-ade1-4242-89de-824599d7b3e0" returned: 0 in 0.277s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:06 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a217e7b0-9874-45d3-9583-2b9e7be59308 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c.info" returned: 0 in 0.248s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-a217e7b0-9874-45d3-9583-2b9e7be59308 tempest-ProjectReaderTests-421961720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.045s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ee653385-5ca6-44f5-93c1-9340a39723e1 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-17c90044-ade1-4242-89de-824599d7b3e0" released by "delete_volume" :: held 0.790s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:06 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-a217e7b0-9874-45d3-9583-2b9e7be59308 tempest-ProjectReaderTests-421961720 None] Create snapshot completed successfully Sep 04 16:08:06 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-ee653385-5ca6-44f5-93c1-9340a39723e1 tempest-ProjectMemberTests-322461420 None] Created reservations ['c5dbff03-9c00-4d25-97a1-b007109744a1', '0370aedf-2996-421a-9fe3-51649c0d2fa7', '7543929a-0efc-43ec-96ea-767db3821e19', '1b83d09f-95a8-47a8-90cb-7461d4c1bd20'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:08:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ee653385-5ca6-44f5-93c1-9340a39723e1 tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ee653385-5ca6-44f5-93c1-9340a39723e1 tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:06 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ee653385-5ca6-44f5-93c1-9340a39723e1 tempest-ProjectMemberTests-322461420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:08:06 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ee653385-5ca6-44f5-93c1-9340a39723e1 tempest-ProjectMemberTests-322461420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:08:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ee653385-5ca6-44f5-93c1-9340a39723e1 tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ee653385-5ca6-44f5-93c1-9340a39723e1 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:06 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:08:06 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:06 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:06 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ee653385-5ca6-44f5-93c1-9340a39723e1 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.281s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:06 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-ee653385-5ca6-44f5-93c1-9340a39723e1 tempest-ProjectMemberTests-322461420 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:08:06 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-ee653385-5ca6-44f5-93c1-9340a39723e1 tempest-ProjectMemberTests-322461420 None] Deleted volume successfully. Sep 04 16:08:06 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-ee653385-5ca6-44f5-93c1-9340a39723e1 tempest-ProjectMemberTests-322461420 None] Lock "cinder-17c90044-ade1-4242-89de-824599d7b3e0-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Flow 'volume_create_manager' (b44daa07-c11a-4dd4-b83a-6b0eda83ecc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2414868e-885a-4e9c-8dc7-4b6087e8f58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2414868e-885a-4e9c-8dc7-4b6087e8f58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1776316675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc5d460-3bb4-476c-9abc-27b2f25a396f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67dc993fc9ce4300852a9f87ee1ded6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:07Z,use_quota=True,user_id='862f7e66540c4c5baa32a03cb34b0c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c0546d8-445e-48c1-8825-80047248dd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c0546d8-445e-48c1-8825-80047248dd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2155737-00f1-4af3-9f0c-0c694cfe51cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2155737-00f1-4af3-9f0c-0c694cfe51cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cc5d460-3bb4-476c-9abc-27b2f25a396f', 'volume_name': 'volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141c8348-902c-4f37-bc48-96fd238981f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141c8348-902c-4f37-bc48-96fd238981f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44680951-1308-4fe4-a141-86db05c9387b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:07 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Volume 4cc5d460-3bb4-476c-9abc-27b2f25a396f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f', 'volume_size': 1} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1776316675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc5d460-3bb4-476c-9abc-27b2f25a396f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67dc993fc9ce4300852a9f87ee1ded6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:07Z,use_quota=True,user_id='862f7e66540c4c5baa32a03cb34b0c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Creating volume 4cc5d460-3bb4-476c-9abc-27b2f25a396f {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:08:07 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:07 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f 1073741824 Sep 04 16:08:07 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-de112e82-8248-4fa6-82a6-b4f7b42bc4d6 tempest-ProjectReaderTests-421961720 None] Acquiring lock "cinder-861f11ea-b63b-4c4a-8bee-563a033fe619-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-de112e82-8248-4fa6-82a6-b4f7b42bc4d6 tempest-ProjectReaderTests-421961720 None] Lock "cinder-861f11ea-b63b-4c4a-8bee-563a033fe619-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-de112e82-8248-4fa6-82a6-b4f7b42bc4d6 tempest-ProjectReaderTests-421961720 None] Acquiring lock "cinder-quobyte-259527b5-2616-42b8-8d9c-5750d08f8f7c" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-de112e82-8248-4fa6-82a6-b4f7b42bc4d6 tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-259527b5-2616-42b8-8d9c-5750d08f8f7c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-de112e82-8248-4fa6-82a6-b4f7b42bc4d6 tempest-ProjectReaderTests-421961720 None] Acquiring lock "cinder-quobyte-861f11ea-b63b-4c4a-8bee-563a033fe619" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-de112e82-8248-4fa6-82a6-b4f7b42bc4d6 tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-861f11ea-b63b-4c4a-8bee-563a033fe619" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-de112e82-8248-4fa6-82a6-b4f7b42bc4d6 tempest-ProjectReaderTests-421961720 None] Deleting offline snapshot 861f11ea-b63b-4c4a-8bee-563a033fe619 of volume 259527b5-2616-42b8-8d9c-5750d08f8f7c {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-de112e82-8248-4fa6-82a6-b4f7b42bc4d6 tempest-ProjectReaderTests-421961720 None] snapshot_file for this snap is: volume-259527b5-2616-42b8-8d9c-5750d08f8f7c.861f11ea-b63b-4c4a-8bee-563a033fe619 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac81baf-0900-441b-9401-53e3d7411713]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-de112e82-8248-4fa6-82a6-b4f7b42bc4d6 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c.861f11ea-b63b-4c4a-8bee-563a033fe619 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:07 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f 1073741824" returned: 0 in 0.482s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:07 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c.861f11ea-b63b-4c4a-8bee-563a033fe619 Sep 04 16:08:07 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:07 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:07 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f Sep 04 16:08:07 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:08 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f" returned: 0 in 0.275s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:08 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:08:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:08 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-de112e82-8248-4fa6-82a6-b4f7b42bc4d6 tempest-ProjectReaderTests-421961720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c.861f11ea-b63b-4c4a-8bee-563a033fe619" returned: 0 in 0.430s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:08 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-de112e82-8248-4fa6-82a6-b4f7b42bc4d6 tempest-ProjectReaderTests-421961720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-259527b5-2616-42b8-8d9c-5750d08f8f7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:08:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44680951-1308-4fe4-a141-86db05c9387b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3f9917-31a5-4ab0-bbb0-992b7e4751b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:08 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb903a2-7d9d-40c7-9fae-c0d8071f2990]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-de112e82-8248-4fa6-82a6-b4f7b42bc4d6 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:08 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Volume volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f (4cc5d460-3bb4-476c-9abc-27b2f25a396f): created successfully Sep 04 16:08:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3f9917-31a5-4ab0-bbb0-992b7e4751b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:08 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Flow 'volume_create_manager' (b44daa07-c11a-4dd4-b83a-6b0eda83ecc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:08:08 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-3c9aa6c9-c4fe-44a6-a5fa-a6afac0c805c tempest-ProjectMemberTests-322461420 None] Created volume successfully. Sep 04 16:08:08 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c Sep 04 16:08:08 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:08 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-de112e82-8248-4fa6-82a6-b4f7b42bc4d6 tempest-ProjectReaderTests-421961720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c" returned: 0 in 0.390s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-de112e82-8248-4fa6-82a6-b4f7b42bc4d6 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c.861f11ea-b63b-4c4a-8bee-563a033fe619 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:08 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c.861f11ea-b63b-4c4a-8bee-563a033fe619 Sep 04 16:08:08 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:08 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-de112e82-8248-4fa6-82a6-b4f7b42bc4d6 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c.861f11ea-b63b-4c4a-8bee-563a033fe619" returned: 0 in 0.355s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:08 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-de112e82-8248-4fa6-82a6-b4f7b42bc4d6 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c.861f11ea-b63b-4c4a-8bee-563a033fe619 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:08 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c.861f11ea-b63b-4c4a-8bee-563a033fe619 Sep 04 16:08:08 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:09 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-de112e82-8248-4fa6-82a6-b4f7b42bc4d6 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c.861f11ea-b63b-4c4a-8bee-563a033fe619" returned: 0 in 0.245s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:09 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-de112e82-8248-4fa6-82a6-b4f7b42bc4d6 tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-861f11ea-b63b-4c4a-8bee-563a033fe619" released by "_delete_snapshot" :: held 1.535s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:09 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-de112e82-8248-4fa6-82a6-b4f7b42bc4d6 tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-259527b5-2616-42b8-8d9c-5750d08f8f7c" released by "delete_snapshot" :: held 1.565s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:09 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-de112e82-8248-4fa6-82a6-b4f7b42bc4d6 tempest-ProjectReaderTests-421961720 None] Created reservations ['9cd0edfe-f1b2-4d8c-a1bd-0dbd9dc68315', 'ca4b14a3-dd15-4280-9a8e-c463f7548665', '67039c42-7af4-44f3-8ba2-ccf07e071a86', '510e4fea-dc91-4824-92fc-e93380bc4cbd'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:08:09 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-de112e82-8248-4fa6-82a6-b4f7b42bc4d6 tempest-ProjectReaderTests-421961720 None] Delete snapshot completed successfully. Sep 04 16:08:09 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-de112e82-8248-4fa6-82a6-b4f7b42bc4d6 tempest-ProjectReaderTests-421961720 None] Lock "cinder-861f11ea-b63b-4c4a-8bee-563a033fe619-delete_snapshot" released by "delete_snapshot" :: held 1.710s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-886b569b-55e8-41f8-83ad-ffc5a8ed69cb tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-886b569b-55e8-41f8-83ad-ffc5a8ed69cb tempest-ProjectMemberTests-322461420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:09 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-886b569b-55e8-41f8-83ad-ffc5a8ed69cb tempest-ProjectMemberTests-322461420 None] Creating offline snapshot 089b7fb4-cbe6-415a-8e09-931bc00b332b of volume 4cc5d460-3bb4-476c-9abc-27b2f25a396f {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:08:09 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9cda84-0d77-444a-ab62-ff63fa84f5e5]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-886b569b-55e8-41f8-83ad-ffc5a8ed69cb tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:09 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f Sep 04 16:08:09 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:09 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-fecd7f18-c968-416b-84ac-f3ed88b856f9 tempest-ProjectReaderTests-421961720 None] Acquiring lock "cinder-259527b5-2616-42b8-8d9c-5750d08f8f7c-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:09 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-fecd7f18-c968-416b-84ac-f3ed88b856f9 tempest-ProjectReaderTests-421961720 None] Lock "cinder-259527b5-2616-42b8-8d9c-5750d08f8f7c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:09 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-fecd7f18-c968-416b-84ac-f3ed88b856f9 tempest-ProjectReaderTests-421961720 None] Acquiring lock "cinder-quobyte-259527b5-2616-42b8-8d9c-5750d08f8f7c" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:09 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-fecd7f18-c968-416b-84ac-f3ed88b856f9 tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-259527b5-2616-42b8-8d9c-5750d08f8f7c" acquired by "delete_volume" :: waited 0.015s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:09 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[99563781-8d15-42c7-b0d9-0294ef4fabcd]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-fecd7f18-c968-416b-84ac-f3ed88b856f9 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:09 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-886b569b-55e8-41f8-83ad-ffc5a8ed69cb tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f" returned: 0 in 0.375s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:09 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-886b569b-55e8-41f8-83ad-ffc5a8ed69cb tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f.089b7fb4-cbe6-415a-8e09-931bc00b332b 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:09 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f.089b7fb4-cbe6-415a-8e09-931bc00b332b 1G Sep 04 16:08:09 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:09 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c Sep 04 16:08:09 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:10 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-fecd7f18-c968-416b-84ac-f3ed88b856f9 tempest-ProjectReaderTests-421961720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c" returned: 0 in 0.361s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-fecd7f18-c968-416b-84ac-f3ed88b856f9 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:10 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c Sep 04 16:08:10 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:10 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-886b569b-55e8-41f8-83ad-ffc5a8ed69cb tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f.089b7fb4-cbe6-415a-8e09-931bc00b332b 1G" returned: 0 in 0.433s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-886b569b-55e8-41f8-83ad-ffc5a8ed69cb tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f.089b7fb4-cbe6-415a-8e09-931bc00b332b {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:10 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f.089b7fb4-cbe6-415a-8e09-931bc00b332b Sep 04 16:08:10 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:10 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-fecd7f18-c968-416b-84ac-f3ed88b856f9 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-259527b5-2616-42b8-8d9c-5750d08f8f7c" returned: 0 in 0.266s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:10 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-fecd7f18-c968-416b-84ac-f3ed88b856f9 tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-259527b5-2616-42b8-8d9c-5750d08f8f7c" released by "delete_volume" :: held 0.684s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:10 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-fecd7f18-c968-416b-84ac-f3ed88b856f9 tempest-ProjectReaderTests-421961720 None] Created reservations ['3fd6a134-9427-4b44-ad9f-77022c650c2d', 'b0a74c98-7590-4590-ae00-035b273cf772', '6062bfa6-ecc8-470a-87cf-afe2580e283f', 'e9761912-c0db-43b2-8548-43a6697f8089'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:08:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-fecd7f18-c968-416b-84ac-f3ed88b856f9 tempest-ProjectReaderTests-421961720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-fecd7f18-c968-416b-84ac-f3ed88b856f9 tempest-ProjectReaderTests-421961720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-fecd7f18-c968-416b-84ac-f3ed88b856f9 tempest-ProjectReaderTests-421961720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:08:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-fecd7f18-c968-416b-84ac-f3ed88b856f9 tempest-ProjectReaderTests-421961720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:08:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-fecd7f18-c968-416b-84ac-f3ed88b856f9 tempest-ProjectReaderTests-421961720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-fecd7f18-c968-416b-84ac-f3ed88b856f9 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:10 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:08:10 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:10 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-886b569b-55e8-41f8-83ad-ffc5a8ed69cb tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f.089b7fb4-cbe6-415a-8e09-931bc00b332b" returned: 0 in 0.334s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:10 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-886b569b-55e8-41f8-83ad-ffc5a8ed69cb tempest-ProjectMemberTests-322461420 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f.089b7fb4-cbe6-415a-8e09-931bc00b332b is being set with open permissions: ugo+rw Sep 04 16:08:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-886b569b-55e8-41f8-83ad-ffc5a8ed69cb tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f.089b7fb4-cbe6-415a-8e09-931bc00b332b {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:10 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f.089b7fb4-cbe6-415a-8e09-931bc00b332b Sep 04 16:08:10 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:10 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-fecd7f18-c968-416b-84ac-f3ed88b856f9 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.247s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:10 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-fecd7f18-c968-416b-84ac-f3ed88b856f9 tempest-ProjectReaderTests-421961720 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:08:10 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-fecd7f18-c968-416b-84ac-f3ed88b856f9 tempest-ProjectReaderTests-421961720 None] Deleted volume successfully. Sep 04 16:08:10 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-fecd7f18-c968-416b-84ac-f3ed88b856f9 tempest-ProjectReaderTests-421961720 None] Lock "cinder-259527b5-2616-42b8-8d9c-5750d08f8f7c-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:10 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-886b569b-55e8-41f8-83ad-ffc5a8ed69cb tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f.089b7fb4-cbe6-415a-8e09-931bc00b332b" returned: 0 in 0.291s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-886b569b-55e8-41f8-83ad-ffc5a8ed69cb tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:10 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f.info Sep 04 16:08:10 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:11 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-886b569b-55e8-41f8-83ad-ffc5a8ed69cb tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f.info" returned: 0 in 0.284s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:11 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-886b569b-55e8-41f8-83ad-ffc5a8ed69cb tempest-ProjectMemberTests-322461420 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f.info is being set with open permissions: ugo+rw Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-886b569b-55e8-41f8-83ad-ffc5a8ed69cb tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:11 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f.info Sep 04 16:08:11 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Flow 'volume_create_manager' (43d3d02a-d402-4266-9e77-2b64acdd14b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44301a2-b578-4a5e-a3e6-87fb8a340b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44301a2-b578-4a5e-a3e6-87fb8a340b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2076998211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cacf3c05-a882-417d-9d96-9e9fb9a3885e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d109122bf84b415d9086c05a28136dc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:11Z,use_quota=True,user_id='ac8b6cb0ead44778a39bb00c297a9126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c98ca8f-f65d-4ef7-be10-640b7cb08754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c98ca8f-f65d-4ef7-be10-640b7cb08754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c02bc21-0c58-4c99-b4ab-62b1eb106eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c02bc21-0c58-4c99-b4ab-62b1eb106eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cacf3c05-a882-417d-9d96-9e9fb9a3885e', 'volume_name': 'volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32a8eef-c926-4cf0-9428-fa5064363c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32a8eef-c926-4cf0-9428-fa5064363c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2578e194-4e51-4834-9fcf-e088a8b88763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:11 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Volume cacf3c05-a882-417d-9d96-9e9fb9a3885e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e', 'volume_size': 1} Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:11 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-886b569b-55e8-41f8-83ad-ffc5a8ed69cb tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f.info" returned: 0 in 0.275s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-886b569b-55e8-41f8-83ad-ffc5a8ed69cb tempest-ProjectMemberTests-322461420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.067s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.090s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2076998211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cacf3c05-a882-417d-9d96-9e9fb9a3885e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d109122bf84b415d9086c05a28136dc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:11Z,use_quota=True,user_id='ac8b6cb0ead44778a39bb00c297a9126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Creating volume cacf3c05-a882-417d-9d96-9e9fb9a3885e {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:08:11 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:11 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e 1073741824 Sep 04 16:08:11 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:11 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-886b569b-55e8-41f8-83ad-ffc5a8ed69cb tempest-ProjectMemberTests-322461420 None] Create snapshot completed successfully Sep 04 16:08:11 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e 1073741824" returned: 0 in 0.414s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:11 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e Sep 04 16:08:11 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:12 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e" returned: 0 in 0.235s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:08:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2578e194-4e51-4834-9fcf-e088a8b88763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e73d5e-e72f-451d-ac5c-5c5a4aeece88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:12 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Volume volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e (cacf3c05-a882-417d-9d96-9e9fb9a3885e): created successfully Sep 04 16:08:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e73d5e-e72f-451d-ac5c-5c5a4aeece88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:12 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Flow 'volume_create_manager' (43d3d02a-d402-4266-9e77-2b64acdd14b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:08:12 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-d8e5ab59-c5a3-4431-a4c3-c4539e7083bf tempest-ProjectReaderTests-421961720 None] Created volume successfully. Sep 04 16:08:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-09665ec7-d8fb-4561-afc1-88cada15f332 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-089b7fb4-cbe6-415a-8e09-931bc00b332b-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-09665ec7-d8fb-4561-afc1-88cada15f332 tempest-ProjectMemberTests-322461420 None] Lock "cinder-089b7fb4-cbe6-415a-8e09-931bc00b332b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-09665ec7-d8fb-4561-afc1-88cada15f332 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-quobyte-4cc5d460-3bb4-476c-9abc-27b2f25a396f" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-09665ec7-d8fb-4561-afc1-88cada15f332 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-4cc5d460-3bb4-476c-9abc-27b2f25a396f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-09665ec7-d8fb-4561-afc1-88cada15f332 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-quobyte-089b7fb4-cbe6-415a-8e09-931bc00b332b" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:12 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-09665ec7-d8fb-4561-afc1-88cada15f332 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-089b7fb4-cbe6-415a-8e09-931bc00b332b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-09665ec7-d8fb-4561-afc1-88cada15f332 tempest-ProjectMemberTests-322461420 None] Deleting offline snapshot 089b7fb4-cbe6-415a-8e09-931bc00b332b of volume 4cc5d460-3bb4-476c-9abc-27b2f25a396f {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:08:12 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-09665ec7-d8fb-4561-afc1-88cada15f332 tempest-ProjectMemberTests-322461420 None] snapshot_file for this snap is: volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f.089b7fb4-cbe6-415a-8e09-931bc00b332b {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:08:12 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[4287efb9-79da-4751-9327-fe6e3d5aab01]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-09665ec7-d8fb-4561-afc1-88cada15f332 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f.089b7fb4-cbe6-415a-8e09-931bc00b332b {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:12 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f.089b7fb4-cbe6-415a-8e09-931bc00b332b Sep 04 16:08:12 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:13 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-09665ec7-d8fb-4561-afc1-88cada15f332 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f.089b7fb4-cbe6-415a-8e09-931bc00b332b" returned: 0 in 0.387s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-09665ec7-d8fb-4561-afc1-88cada15f332 tempest-ProjectMemberTests-322461420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:08:13 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b00d73-31ba-4012-87be-375ff15b15e7]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-09665ec7-d8fb-4561-afc1-88cada15f332 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:13 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f Sep 04 16:08:13 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:13 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-09665ec7-d8fb-4561-afc1-88cada15f332 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f" returned: 0 in 0.399s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-09665ec7-d8fb-4561-afc1-88cada15f332 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f.089b7fb4-cbe6-415a-8e09-931bc00b332b {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:13 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f.089b7fb4-cbe6-415a-8e09-931bc00b332b Sep 04 16:08:13 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-cef005aa-0456-463c-8327-8845fe89f182 tempest-ProjectReaderTests-421961720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-cef005aa-0456-463c-8327-8845fe89f182 tempest-ProjectReaderTests-421961720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:13 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-cef005aa-0456-463c-8327-8845fe89f182 tempest-ProjectReaderTests-421961720 None] Creating offline snapshot a94730d9-1271-45ec-8878-510c62f89e6f of volume cacf3c05-a882-417d-9d96-9e9fb9a3885e {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:08:13 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c0277d-4ce5-49bf-8fdd-039ded2e2fbf]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cef005aa-0456-463c-8327-8845fe89f182 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:13 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e Sep 04 16:08:13 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:13 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-09665ec7-d8fb-4561-afc1-88cada15f332 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f.089b7fb4-cbe6-415a-8e09-931bc00b332b" returned: 0 in 0.368s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-09665ec7-d8fb-4561-afc1-88cada15f332 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f.089b7fb4-cbe6-415a-8e09-931bc00b332b {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:13 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f.089b7fb4-cbe6-415a-8e09-931bc00b332b Sep 04 16:08:13 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:14 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cef005aa-0456-463c-8327-8845fe89f182 tempest-ProjectReaderTests-421961720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e" returned: 0 in 0.426s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cef005aa-0456-463c-8327-8845fe89f182 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e.a94730d9-1271-45ec-8878-510c62f89e6f 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:14 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e.a94730d9-1271-45ec-8878-510c62f89e6f 1G Sep 04 16:08:14 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:14 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-09665ec7-d8fb-4561-afc1-88cada15f332 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f.089b7fb4-cbe6-415a-8e09-931bc00b332b" returned: 0 in 0.250s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-09665ec7-d8fb-4561-afc1-88cada15f332 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-089b7fb4-cbe6-415a-8e09-931bc00b332b" released by "_delete_snapshot" :: held 1.499s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-09665ec7-d8fb-4561-afc1-88cada15f332 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-4cc5d460-3bb4-476c-9abc-27b2f25a396f" released by "delete_snapshot" :: held 1.525s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:14 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-09665ec7-d8fb-4561-afc1-88cada15f332 tempest-ProjectMemberTests-322461420 None] Created reservations ['a25257ed-c390-435a-a954-3a7d82021293', 'f20fabd3-2922-414f-a2ca-44ffba8a0353', 'bf0727de-267b-45d5-95a5-0511c2255bbb', '9659ced5-cc74-4f5f-bd6e-c712ea6838d7'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:08:14 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-09665ec7-d8fb-4561-afc1-88cada15f332 tempest-ProjectMemberTests-322461420 None] Delete snapshot completed successfully. Sep 04 16:08:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-09665ec7-d8fb-4561-afc1-88cada15f332 tempest-ProjectMemberTests-322461420 None] Lock "cinder-089b7fb4-cbe6-415a-8e09-931bc00b332b-delete_snapshot" released by "delete_snapshot" :: held 1.688s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:14 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cef005aa-0456-463c-8327-8845fe89f182 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e.a94730d9-1271-45ec-8878-510c62f89e6f 1G" returned: 0 in 0.407s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cef005aa-0456-463c-8327-8845fe89f182 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e.a94730d9-1271-45ec-8878-510c62f89e6f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:14 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e.a94730d9-1271-45ec-8878-510c62f89e6f Sep 04 16:08:14 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-027552e7-2bd0-4e5f-a589-fdfa833b6541 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-4cc5d460-3bb4-476c-9abc-27b2f25a396f-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-027552e7-2bd0-4e5f-a589-fdfa833b6541 tempest-ProjectMemberTests-322461420 None] Lock "cinder-4cc5d460-3bb4-476c-9abc-27b2f25a396f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:14 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cef005aa-0456-463c-8327-8845fe89f182 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e.a94730d9-1271-45ec-8878-510c62f89e6f" returned: 0 in 0.331s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:14 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-cef005aa-0456-463c-8327-8845fe89f182 tempest-ProjectReaderTests-421961720 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e.a94730d9-1271-45ec-8878-510c62f89e6f is being set with open permissions: ugo+rw Sep 04 16:08:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cef005aa-0456-463c-8327-8845fe89f182 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e.a94730d9-1271-45ec-8878-510c62f89e6f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:14 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e.a94730d9-1271-45ec-8878-510c62f89e6f Sep 04 16:08:14 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-027552e7-2bd0-4e5f-a589-fdfa833b6541 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-quobyte-4cc5d460-3bb4-476c-9abc-27b2f25a396f" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-027552e7-2bd0-4e5f-a589-fdfa833b6541 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-4cc5d460-3bb4-476c-9abc-27b2f25a396f" acquired by "delete_volume" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:14 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce426f3-7709-4bb7-b006-1b7f6772ba9c]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-027552e7-2bd0-4e5f-a589-fdfa833b6541 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:14 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f Sep 04 16:08:14 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:15 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cef005aa-0456-463c-8327-8845fe89f182 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e.a94730d9-1271-45ec-8878-510c62f89e6f" returned: 0 in 0.285s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cef005aa-0456-463c-8327-8845fe89f182 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:15 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e.info Sep 04 16:08:15 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:15 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-027552e7-2bd0-4e5f-a589-fdfa833b6541 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f" returned: 0 in 0.418s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-027552e7-2bd0-4e5f-a589-fdfa833b6541 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:15 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f Sep 04 16:08:15 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:15 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cef005aa-0456-463c-8327-8845fe89f182 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e.info" returned: 0 in 0.290s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:15 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-cef005aa-0456-463c-8327-8845fe89f182 tempest-ProjectReaderTests-421961720 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e.info is being set with open permissions: ugo+rw Sep 04 16:08:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cef005aa-0456-463c-8327-8845fe89f182 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:15 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e.info Sep 04 16:08:15 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:15 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-027552e7-2bd0-4e5f-a589-fdfa833b6541 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-4cc5d460-3bb4-476c-9abc-27b2f25a396f" returned: 0 in 0.265s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:15 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-027552e7-2bd0-4e5f-a589-fdfa833b6541 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-4cc5d460-3bb4-476c-9abc-27b2f25a396f" released by "delete_volume" :: held 0.756s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:15 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-027552e7-2bd0-4e5f-a589-fdfa833b6541 tempest-ProjectMemberTests-322461420 None] Created reservations ['5b3cd271-6e0e-45c9-ae27-55a7c55acf04', '7048e4fa-fb63-4581-ba4f-1fc3b6822324', '09debff8-b48b-43b8-8cb1-5aae83e9a489', 'd8045775-b4ad-47d1-aa9e-5db468f1dc64'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:08:15 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-cef005aa-0456-463c-8327-8845fe89f182 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e.info" returned: 0 in 0.304s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-cef005aa-0456-463c-8327-8845fe89f182 tempest-ProjectReaderTests-421961720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.128s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:15 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-cef005aa-0456-463c-8327-8845fe89f182 tempest-ProjectReaderTests-421961720 None] Create snapshot completed successfully Sep 04 16:08:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-027552e7-2bd0-4e5f-a589-fdfa833b6541 tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-027552e7-2bd0-4e5f-a589-fdfa833b6541 tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:15 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-027552e7-2bd0-4e5f-a589-fdfa833b6541 tempest-ProjectMemberTests-322461420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:08:15 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-027552e7-2bd0-4e5f-a589-fdfa833b6541 tempest-ProjectMemberTests-322461420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:08:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-027552e7-2bd0-4e5f-a589-fdfa833b6541 tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:15 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-027552e7-2bd0-4e5f-a589-fdfa833b6541 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:15 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:08:15 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:16 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-027552e7-2bd0-4e5f-a589-fdfa833b6541 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.265s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-027552e7-2bd0-4e5f-a589-fdfa833b6541 tempest-ProjectMemberTests-322461420 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:08:16 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-027552e7-2bd0-4e5f-a589-fdfa833b6541 tempest-ProjectMemberTests-322461420 None] Deleted volume successfully. Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-027552e7-2bd0-4e5f-a589-fdfa833b6541 tempest-ProjectMemberTests-322461420 None] Lock "cinder-4cc5d460-3bb4-476c-9abc-27b2f25a396f-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Flow 'volume_create_manager' (fa6474b0-09ca-454e-ace7-fff03ea71d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1390b3be-caf1-4376-b168-e021403641fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1390b3be-caf1-4376-b168-e021403641fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1991803081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df52e0a8-0a2a-4c60-8df7-53a824841f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67dc993fc9ce4300852a9f87ee1ded6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:16Z,use_quota=True,user_id='862f7e66540c4c5baa32a03cb34b0c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a984928-3e6c-4eba-a6f5-4ab4c256c7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a984928-3e6c-4eba-a6f5-4ab4c256c7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1fb463-e22d-46d1-87ae-741dab8e2329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1fb463-e22d-46d1-87ae-741dab8e2329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df52e0a8-0a2a-4c60-8df7-53a824841f23', 'volume_name': 'volume-df52e0a8-0a2a-4c60-8df7-53a824841f23', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264fc7cb-20a5-4881-a5f5-757d3d52efd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264fc7cb-20a5-4881-a5f5-757d3d52efd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87375811-b1a5-4d54-a501-c38a71a76476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:16 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Volume df52e0a8-0a2a-4c60-8df7-53a824841f23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df52e0a8-0a2a-4c60-8df7-53a824841f23', 'volume_size': 1} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1991803081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df52e0a8-0a2a-4c60-8df7-53a824841f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67dc993fc9ce4300852a9f87ee1ded6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:16Z,use_quota=True,user_id='862f7e66540c4c5baa32a03cb34b0c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Creating volume df52e0a8-0a2a-4c60-8df7-53a824841f23 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:08:16 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:16 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23 1073741824 Sep 04 16:08:16 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4ecca26e-41ac-4218-a507-76c32430ed48 tempest-ProjectReaderTests-421961720 None] Acquiring lock "cinder-a94730d9-1271-45ec-8878-510c62f89e6f-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4ecca26e-41ac-4218-a507-76c32430ed48 tempest-ProjectReaderTests-421961720 None] Lock "cinder-a94730d9-1271-45ec-8878-510c62f89e6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4ecca26e-41ac-4218-a507-76c32430ed48 tempest-ProjectReaderTests-421961720 None] Acquiring lock "cinder-quobyte-cacf3c05-a882-417d-9d96-9e9fb9a3885e" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4ecca26e-41ac-4218-a507-76c32430ed48 tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-cacf3c05-a882-417d-9d96-9e9fb9a3885e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4ecca26e-41ac-4218-a507-76c32430ed48 tempest-ProjectReaderTests-421961720 None] Acquiring lock "cinder-quobyte-a94730d9-1271-45ec-8878-510c62f89e6f" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4ecca26e-41ac-4218-a507-76c32430ed48 tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-a94730d9-1271-45ec-8878-510c62f89e6f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-4ecca26e-41ac-4218-a507-76c32430ed48 tempest-ProjectReaderTests-421961720 None] Deleting offline snapshot a94730d9-1271-45ec-8878-510c62f89e6f of volume cacf3c05-a882-417d-9d96-9e9fb9a3885e {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-4ecca26e-41ac-4218-a507-76c32430ed48 tempest-ProjectReaderTests-421961720 None] snapshot_file for this snap is: volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e.a94730d9-1271-45ec-8878-510c62f89e6f {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[222c4d62-4762-4534-a60f-caea1e01a591]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ecca26e-41ac-4218-a507-76c32430ed48 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e.a94730d9-1271-45ec-8878-510c62f89e6f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:16 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23 1073741824" returned: 0 in 0.475s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:16 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e.a94730d9-1271-45ec-8878-510c62f89e6f Sep 04 16:08:16 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:16 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:17 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23 Sep 04 16:08:17 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:17 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ecca26e-41ac-4218-a507-76c32430ed48 tempest-ProjectReaderTests-421961720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e.a94730d9-1271-45ec-8878-510c62f89e6f" returned: 0 in 0.396s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:17 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-4ecca26e-41ac-4218-a507-76c32430ed48 tempest-ProjectReaderTests-421961720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:08:17 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23" returned: 0 in 0.279s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:17 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:08:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:17 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f2a847-78b9-4aa7-81de-975b7184a15c]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ecca26e-41ac-4218-a507-76c32430ed48 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87375811-b1a5-4d54-a501-c38a71a76476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df52e0a8-0a2a-4c60-8df7-53a824841f23', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e07236c-62ab-440e-b7a3-f64d29d62af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:17 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Volume volume-df52e0a8-0a2a-4c60-8df7-53a824841f23 (df52e0a8-0a2a-4c60-8df7-53a824841f23): created successfully Sep 04 16:08:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e07236c-62ab-440e-b7a3-f64d29d62af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:17 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Flow 'volume_create_manager' (fa6474b0-09ca-454e-ace7-fff03ea71d79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:08:17 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-d6897666-b337-4d97-a29c-8a2e2ac607e8 tempest-ProjectMemberTests-322461420 None] Created volume successfully. Sep 04 16:08:17 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e Sep 04 16:08:17 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:17 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ecca26e-41ac-4218-a507-76c32430ed48 tempest-ProjectReaderTests-421961720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e" returned: 0 in 0.393s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:17 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ecca26e-41ac-4218-a507-76c32430ed48 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e.a94730d9-1271-45ec-8878-510c62f89e6f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:17 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e.a94730d9-1271-45ec-8878-510c62f89e6f Sep 04 16:08:17 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:18 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ecca26e-41ac-4218-a507-76c32430ed48 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e.a94730d9-1271-45ec-8878-510c62f89e6f" returned: 0 in 0.362s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ecca26e-41ac-4218-a507-76c32430ed48 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e.a94730d9-1271-45ec-8878-510c62f89e6f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:18 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e.a94730d9-1271-45ec-8878-510c62f89e6f Sep 04 16:08:18 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:18 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ecca26e-41ac-4218-a507-76c32430ed48 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e.a94730d9-1271-45ec-8878-510c62f89e6f" returned: 0 in 0.253s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:18 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4ecca26e-41ac-4218-a507-76c32430ed48 tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-a94730d9-1271-45ec-8878-510c62f89e6f" released by "_delete_snapshot" :: held 1.508s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:18 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4ecca26e-41ac-4218-a507-76c32430ed48 tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-cacf3c05-a882-417d-9d96-9e9fb9a3885e" released by "delete_snapshot" :: held 1.535s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:18 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-4ecca26e-41ac-4218-a507-76c32430ed48 tempest-ProjectReaderTests-421961720 None] Created reservations ['52cc8305-91e3-4ea5-b0af-ec819cad5f80', '669a4b1b-0e9d-49bb-8a20-9ab368f71120', '1782962f-d7d1-4a6b-9b82-412ba0aab5e8', 'e17f2af5-0c83-431e-abf5-ac9f7fbdc5be'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:08:18 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-4ecca26e-41ac-4218-a507-76c32430ed48 tempest-ProjectReaderTests-421961720 None] Delete snapshot completed successfully. Sep 04 16:08:18 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4ecca26e-41ac-4218-a507-76c32430ed48 tempest-ProjectReaderTests-421961720 None] Lock "cinder-a94730d9-1271-45ec-8878-510c62f89e6f-delete_snapshot" released by "delete_snapshot" :: held 1.693s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7149b496-2b40-4043-88b8-585811ed7ca2 tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7149b496-2b40-4043-88b8-585811ed7ca2 tempest-ProjectMemberTests-322461420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:18 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-7149b496-2b40-4043-88b8-585811ed7ca2 tempest-ProjectMemberTests-322461420 None] Creating offline snapshot 6156fdb2-93b9-4af8-9381-3a6fbd0fd019 of volume df52e0a8-0a2a-4c60-8df7-53a824841f23 {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:08:18 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[747acf82-2f92-4def-8436-503749fdfaf8]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7149b496-2b40-4043-88b8-585811ed7ca2 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:18 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23 Sep 04 16:08:18 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:18 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1b34050a-1f7b-4f00-a15c-764e1e190a08 tempest-ProjectReaderTests-421961720 None] Acquiring lock "cinder-cacf3c05-a882-417d-9d96-9e9fb9a3885e-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:18 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1b34050a-1f7b-4f00-a15c-764e1e190a08 tempest-ProjectReaderTests-421961720 None] Lock "cinder-cacf3c05-a882-417d-9d96-9e9fb9a3885e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1b34050a-1f7b-4f00-a15c-764e1e190a08 tempest-ProjectReaderTests-421961720 None] Acquiring lock "cinder-quobyte-cacf3c05-a882-417d-9d96-9e9fb9a3885e" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1b34050a-1f7b-4f00-a15c-764e1e190a08 tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-cacf3c05-a882-417d-9d96-9e9fb9a3885e" acquired by "delete_volume" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:19 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7149b496-2b40-4043-88b8-585811ed7ca2 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23" returned: 0 in 0.408s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7149b496-2b40-4043-88b8-585811ed7ca2 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23.6156fdb2-93b9-4af8-9381-3a6fbd0fd019 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:19 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee8f9af-13c4-4535-b6a3-9b1b6f250ebf]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1b34050a-1f7b-4f00-a15c-764e1e190a08 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:19 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23.6156fdb2-93b9-4af8-9381-3a6fbd0fd019 1G Sep 04 16:08:19 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:19 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e Sep 04 16:08:19 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:19 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1b34050a-1f7b-4f00-a15c-764e1e190a08 tempest-ProjectReaderTests-421961720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e" returned: 0 in 0.401s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1b34050a-1f7b-4f00-a15c-764e1e190a08 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:19 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7149b496-2b40-4043-88b8-585811ed7ca2 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23.6156fdb2-93b9-4af8-9381-3a6fbd0fd019 1G" returned: 0 in 0.443s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7149b496-2b40-4043-88b8-585811ed7ca2 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df52e0a8-0a2a-4c60-8df7-53a824841f23 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23.6156fdb2-93b9-4af8-9381-3a6fbd0fd019 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:19 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e Sep 04 16:08:19 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:19 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df52e0a8-0a2a-4c60-8df7-53a824841f23 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23.6156fdb2-93b9-4af8-9381-3a6fbd0fd019 Sep 04 16:08:19 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:19 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1b34050a-1f7b-4f00-a15c-764e1e190a08 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-cacf3c05-a882-417d-9d96-9e9fb9a3885e" returned: 0 in 0.250s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1b34050a-1f7b-4f00-a15c-764e1e190a08 tempest-ProjectReaderTests-421961720 None] Lock "cinder-quobyte-cacf3c05-a882-417d-9d96-9e9fb9a3885e" released by "delete_volume" :: held 0.724s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:19 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-1b34050a-1f7b-4f00-a15c-764e1e190a08 tempest-ProjectReaderTests-421961720 None] Created reservations ['1e3ae45b-d3ab-4936-bb3b-d3c24b7fc1d0', '86961cbd-7c8c-49ce-9e4e-9f663d59344f', 'dc9fdd95-6bd4-42b6-a4fd-b19f2c76b9d1', 'efb8a205-01b9-421d-8d29-be4482f9b555'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:08:19 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7149b496-2b40-4043-88b8-585811ed7ca2 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df52e0a8-0a2a-4c60-8df7-53a824841f23 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23.6156fdb2-93b9-4af8-9381-3a6fbd0fd019" returned: 0 in 0.336s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:19 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-7149b496-2b40-4043-88b8-585811ed7ca2 tempest-ProjectMemberTests-322461420 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23.6156fdb2-93b9-4af8-9381-3a6fbd0fd019 is being set with open permissions: ugo+rw Sep 04 16:08:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7149b496-2b40-4043-88b8-585811ed7ca2 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23.6156fdb2-93b9-4af8-9381-3a6fbd0fd019 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:19 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23.6156fdb2-93b9-4af8-9381-3a6fbd0fd019 Sep 04 16:08:19 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1b34050a-1f7b-4f00-a15c-764e1e190a08 tempest-ProjectReaderTests-421961720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1b34050a-1f7b-4f00-a15c-764e1e190a08 tempest-ProjectReaderTests-421961720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1b34050a-1f7b-4f00-a15c-764e1e190a08 tempest-ProjectReaderTests-421961720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:08:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-1b34050a-1f7b-4f00-a15c-764e1e190a08 tempest-ProjectReaderTests-421961720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:08:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-1b34050a-1f7b-4f00-a15c-764e1e190a08 tempest-ProjectReaderTests-421961720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1b34050a-1f7b-4f00-a15c-764e1e190a08 tempest-ProjectReaderTests-421961720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:19 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:08:19 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:20 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7149b496-2b40-4043-88b8-585811ed7ca2 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23.6156fdb2-93b9-4af8-9381-3a6fbd0fd019" returned: 0 in 0.273s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7149b496-2b40-4043-88b8-585811ed7ca2 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:20 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:20 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23.info Sep 04 16:08:20 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1b34050a-1f7b-4f00-a15c-764e1e190a08 tempest-ProjectReaderTests-421961720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.286s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:20 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-1b34050a-1f7b-4f00-a15c-764e1e190a08 tempest-ProjectReaderTests-421961720 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:08:20 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-1b34050a-1f7b-4f00-a15c-764e1e190a08 tempest-ProjectReaderTests-421961720 None] Deleted volume successfully. Sep 04 16:08:20 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1b34050a-1f7b-4f00-a15c-764e1e190a08 tempest-ProjectReaderTests-421961720 None] Lock "cinder-cacf3c05-a882-417d-9d96-9e9fb9a3885e-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:20 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7149b496-2b40-4043-88b8-585811ed7ca2 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23.info" returned: 0 in 0.316s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:20 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-7149b496-2b40-4043-88b8-585811ed7ca2 tempest-ProjectMemberTests-322461420 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23.info is being set with open permissions: ugo+rw Sep 04 16:08:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7149b496-2b40-4043-88b8-585811ed7ca2 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:20 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23.info Sep 04 16:08:20 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:20 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-7149b496-2b40-4043-88b8-585811ed7ca2 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23.info" returned: 0 in 0.298s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-7149b496-2b40-4043-88b8-585811ed7ca2 tempest-ProjectMemberTests-322461420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.165s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:20 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-7149b496-2b40-4043-88b8-585811ed7ca2 tempest-ProjectMemberTests-322461420 None] Create snapshot completed successfully Sep 04 16:08:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1cf6880e-af65-4628-9b55-0ef419602bf9 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-6156fdb2-93b9-4af8-9381-3a6fbd0fd019-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1cf6880e-af65-4628-9b55-0ef419602bf9 tempest-ProjectMemberTests-322461420 None] Lock "cinder-6156fdb2-93b9-4af8-9381-3a6fbd0fd019-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1cf6880e-af65-4628-9b55-0ef419602bf9 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-quobyte-df52e0a8-0a2a-4c60-8df7-53a824841f23" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1cf6880e-af65-4628-9b55-0ef419602bf9 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-df52e0a8-0a2a-4c60-8df7-53a824841f23" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1cf6880e-af65-4628-9b55-0ef419602bf9 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-quobyte-6156fdb2-93b9-4af8-9381-3a6fbd0fd019" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1cf6880e-af65-4628-9b55-0ef419602bf9 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-6156fdb2-93b9-4af8-9381-3a6fbd0fd019" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:21 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-1cf6880e-af65-4628-9b55-0ef419602bf9 tempest-ProjectMemberTests-322461420 None] Deleting offline snapshot 6156fdb2-93b9-4af8-9381-3a6fbd0fd019 of volume df52e0a8-0a2a-4c60-8df7-53a824841f23 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:08:21 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-1cf6880e-af65-4628-9b55-0ef419602bf9 tempest-ProjectMemberTests-322461420 None] snapshot_file for this snap is: volume-df52e0a8-0a2a-4c60-8df7-53a824841f23.6156fdb2-93b9-4af8-9381-3a6fbd0fd019 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:08:21 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1053cd1-af68-40fa-a042-1625853e64d6]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1cf6880e-af65-4628-9b55-0ef419602bf9 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23.6156fdb2-93b9-4af8-9381-3a6fbd0fd019 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:22 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23.6156fdb2-93b9-4af8-9381-3a6fbd0fd019 Sep 04 16:08:22 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:22 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1cf6880e-af65-4628-9b55-0ef419602bf9 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23.6156fdb2-93b9-4af8-9381-3a6fbd0fd019" returned: 0 in 0.437s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-1cf6880e-af65-4628-9b55-0ef419602bf9 tempest-ProjectMemberTests-322461420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df52e0a8-0a2a-4c60-8df7-53a824841f23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:08:22 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba1612f-9fe2-407a-9d1c-911fed98c81d]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1cf6880e-af65-4628-9b55-0ef419602bf9 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:22 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23 Sep 04 16:08:22 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:22 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1cf6880e-af65-4628-9b55-0ef419602bf9 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23" returned: 0 in 0.395s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1cf6880e-af65-4628-9b55-0ef419602bf9 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23.6156fdb2-93b9-4af8-9381-3a6fbd0fd019 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:22 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23.6156fdb2-93b9-4af8-9381-3a6fbd0fd019 Sep 04 16:08:22 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:23 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1cf6880e-af65-4628-9b55-0ef419602bf9 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23.6156fdb2-93b9-4af8-9381-3a6fbd0fd019" returned: 0 in 0.404s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1cf6880e-af65-4628-9b55-0ef419602bf9 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23.6156fdb2-93b9-4af8-9381-3a6fbd0fd019 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:23 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23.6156fdb2-93b9-4af8-9381-3a6fbd0fd019 Sep 04 16:08:23 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:23 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-1cf6880e-af65-4628-9b55-0ef419602bf9 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23.6156fdb2-93b9-4af8-9381-3a6fbd0fd019" returned: 0 in 0.266s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1cf6880e-af65-4628-9b55-0ef419602bf9 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-6156fdb2-93b9-4af8-9381-3a6fbd0fd019" released by "_delete_snapshot" :: held 1.609s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1cf6880e-af65-4628-9b55-0ef419602bf9 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-df52e0a8-0a2a-4c60-8df7-53a824841f23" released by "delete_snapshot" :: held 1.639s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:23 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-1cf6880e-af65-4628-9b55-0ef419602bf9 tempest-ProjectMemberTests-322461420 None] Created reservations ['716d3c3b-9c3f-4291-8562-34c5831a8545', '662a0683-db04-4391-bad5-eef71bb0e9d9', '42b25d25-c9c3-43fb-b9ff-2300e4940681', 'b928c622-4f2b-4405-a1fb-7276dabac7df'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:08:23 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-1cf6880e-af65-4628-9b55-0ef419602bf9 tempest-ProjectMemberTests-322461420 None] Delete snapshot completed successfully. Sep 04 16:08:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-1cf6880e-af65-4628-9b55-0ef419602bf9 tempest-ProjectMemberTests-322461420 None] Lock "cinder-6156fdb2-93b9-4af8-9381-3a6fbd0fd019-delete_snapshot" released by "delete_snapshot" :: held 1.804s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:24 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d5abbea9-2818-4984-ae24-508aef444e57 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-df52e0a8-0a2a-4c60-8df7-53a824841f23-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:24 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d5abbea9-2818-4984-ae24-508aef444e57 tempest-ProjectMemberTests-322461420 None] Lock "cinder-df52e0a8-0a2a-4c60-8df7-53a824841f23-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:24 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d5abbea9-2818-4984-ae24-508aef444e57 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-quobyte-df52e0a8-0a2a-4c60-8df7-53a824841f23" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:24 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d5abbea9-2818-4984-ae24-508aef444e57 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-df52e0a8-0a2a-4c60-8df7-53a824841f23" acquired by "delete_volume" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:24 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[69717e81-4bed-4ea9-ac2c-0679d9d3f8ef]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d5abbea9-2818-4984-ae24-508aef444e57 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:24 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23 Sep 04 16:08:24 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:24 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d5abbea9-2818-4984-ae24-508aef444e57 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23" returned: 0 in 0.407s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d5abbea9-2818-4984-ae24-508aef444e57 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:24 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23 Sep 04 16:08:24 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:24 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d5abbea9-2818-4984-ae24-508aef444e57 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-df52e0a8-0a2a-4c60-8df7-53a824841f23" returned: 0 in 0.276s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:24 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d5abbea9-2818-4984-ae24-508aef444e57 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-df52e0a8-0a2a-4c60-8df7-53a824841f23" released by "delete_volume" :: held 0.756s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:24 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-d5abbea9-2818-4984-ae24-508aef444e57 tempest-ProjectMemberTests-322461420 None] Created reservations ['8ff255f4-74c9-44b0-9bf7-a3d99392c939', 'e3e1e076-427a-4828-9490-3da31bd2a0ce', '3ec18a18-34db-4daa-b89d-ddc6cfa4f623', 'c56f64be-6d81-4452-ba8c-64b4f00b27f0'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:08:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d5abbea9-2818-4984-ae24-508aef444e57 tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d5abbea9-2818-4984-ae24-508aef444e57 tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:24 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d5abbea9-2818-4984-ae24-508aef444e57 tempest-ProjectMemberTests-322461420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:08:24 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d5abbea9-2818-4984-ae24-508aef444e57 tempest-ProjectMemberTests-322461420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:08:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d5abbea9-2818-4984-ae24-508aef444e57 tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:24 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d5abbea9-2818-4984-ae24-508aef444e57 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:25 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:08:25 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:25 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d5abbea9-2818-4984-ae24-508aef444e57 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.278s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:25 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d5abbea9-2818-4984-ae24-508aef444e57 tempest-ProjectMemberTests-322461420 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:08:25 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-d5abbea9-2818-4984-ae24-508aef444e57 tempest-ProjectMemberTests-322461420 None] Deleted volume successfully. Sep 04 16:08:25 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-d5abbea9-2818-4984-ae24-508aef444e57 tempest-ProjectMemberTests-322461420 None] Lock "cinder-df52e0a8-0a2a-4c60-8df7-53a824841f23-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:25 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:08:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Flow 'volume_create_manager' (726c414a-e007-4b14-8804-9bd0b0169c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:08:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab621e2e-caf6-463b-829f-ebcf3fa19954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab621e2e-caf6-463b-829f-ebcf3fa19954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1310471114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=915b07a7-254c-443d-a746-aa500b738292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67dc993fc9ce4300852a9f87ee1ded6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:26Z,use_quota=True,user_id='862f7e66540c4c5baa32a03cb34b0c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2311455-b1bd-4107-be09-591a0969488c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2311455-b1bd-4107-be09-591a0969488c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be957e3-2ed7-4cae-a14b-5047a2174a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be957e3-2ed7-4cae-a14b-5047a2174a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '915b07a7-254c-443d-a746-aa500b738292', 'volume_name': 'volume-915b07a7-254c-443d-a746-aa500b738292', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b08767-4902-4c44-bd26-75836899d204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b08767-4902-4c44-bd26-75836899d204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:25 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c701d0af-84e2-48e1-9496-d6a055919137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:25 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Volume 915b07a7-254c-443d-a746-aa500b738292: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-915b07a7-254c-443d-a746-aa500b738292', 'volume_size': 1} Sep 04 16:08:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1310471114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=915b07a7-254c-443d-a746-aa500b738292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67dc993fc9ce4300852a9f87ee1ded6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:26Z,use_quota=True,user_id='862f7e66540c4c5baa32a03cb34b0c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:08:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Creating volume 915b07a7-254c-443d-a746-aa500b738292 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:08:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:08:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:08:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:25 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:08:25 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:08:25 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:25 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292 1073741824 Sep 04 16:08:25 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:26 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292 1073741824" returned: 0 in 0.495s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:26 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292 Sep 04 16:08:26 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:26 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292" returned: 0 in 0.285s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:26 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:08:26 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c701d0af-84e2-48e1-9496-d6a055919137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-915b07a7-254c-443d-a746-aa500b738292', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ede4a8-c5be-4c79-ae1d-d9dbb6dcb94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:26 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Volume volume-915b07a7-254c-443d-a746-aa500b738292 (915b07a7-254c-443d-a746-aa500b738292): created successfully Sep 04 16:08:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ede4a8-c5be-4c79-ae1d-d9dbb6dcb94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:26 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Flow 'volume_create_manager' (726c414a-e007-4b14-8804-9bd0b0169c85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:08:26 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-ad9ff90e-61c5-4ad8-9ce7-004904c6490e tempest-ProjectMemberTests-322461420 None] Created volume successfully. Sep 04 16:08:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e75b9976-2254-4d41-bb5e-f6e22179ee80 tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:27 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e75b9976-2254-4d41-bb5e-f6e22179ee80 tempest-ProjectMemberTests-322461420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:27 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-e75b9976-2254-4d41-bb5e-f6e22179ee80 tempest-ProjectMemberTests-322461420 None] Creating offline snapshot 887f04a7-366a-452a-8763-228150317fc2 of volume 915b07a7-254c-443d-a746-aa500b738292 {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:08:28 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5c6ad9-cb46-46a2-ac5e-851788757aa5]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e75b9976-2254-4d41-bb5e-f6e22179ee80 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:28 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292 Sep 04 16:08:28 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:28 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e75b9976-2254-4d41-bb5e-f6e22179ee80 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292" returned: 0 in 0.393s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e75b9976-2254-4d41-bb5e-f6e22179ee80 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292.887f04a7-366a-452a-8763-228150317fc2 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:28 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292.887f04a7-366a-452a-8763-228150317fc2 1G Sep 04 16:08:28 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:28 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e75b9976-2254-4d41-bb5e-f6e22179ee80 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292.887f04a7-366a-452a-8763-228150317fc2 1G" returned: 0 in 0.445s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:28 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e75b9976-2254-4d41-bb5e-f6e22179ee80 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-915b07a7-254c-443d-a746-aa500b738292 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292.887f04a7-366a-452a-8763-228150317fc2 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:28 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-915b07a7-254c-443d-a746-aa500b738292 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292.887f04a7-366a-452a-8763-228150317fc2 Sep 04 16:08:28 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:29 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e75b9976-2254-4d41-bb5e-f6e22179ee80 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-915b07a7-254c-443d-a746-aa500b738292 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292.887f04a7-366a-452a-8763-228150317fc2" returned: 0 in 0.300s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:29 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-e75b9976-2254-4d41-bb5e-f6e22179ee80 tempest-ProjectMemberTests-322461420 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292.887f04a7-366a-452a-8763-228150317fc2 is being set with open permissions: ugo+rw Sep 04 16:08:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e75b9976-2254-4d41-bb5e-f6e22179ee80 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292.887f04a7-366a-452a-8763-228150317fc2 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:29 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292.887f04a7-366a-452a-8763-228150317fc2 Sep 04 16:08:29 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:29 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e75b9976-2254-4d41-bb5e-f6e22179ee80 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292.887f04a7-366a-452a-8763-228150317fc2" returned: 0 in 0.246s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e75b9976-2254-4d41-bb5e-f6e22179ee80 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:29 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292.info Sep 04 16:08:29 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:29 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e75b9976-2254-4d41-bb5e-f6e22179ee80 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292.info" returned: 0 in 0.271s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:29 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-e75b9976-2254-4d41-bb5e-f6e22179ee80 tempest-ProjectMemberTests-322461420 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292.info is being set with open permissions: ugo+rw Sep 04 16:08:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e75b9976-2254-4d41-bb5e-f6e22179ee80 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:29 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292.info Sep 04 16:08:29 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:29 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:29 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-e75b9976-2254-4d41-bb5e-f6e22179ee80 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292.info" returned: 0 in 0.283s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:30 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-e75b9976-2254-4d41-bb5e-f6e22179ee80 tempest-ProjectMemberTests-322461420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.044s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:30 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-e75b9976-2254-4d41-bb5e-f6e22179ee80 tempest-ProjectMemberTests-322461420 None] Create snapshot completed successfully Sep 04 16:08:30 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=178,cinder:UPDATE=201,cinder:INSERT=59,cinder:DELETE=19 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:08:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-56a5eeda-49d3-4623-9fb5-529dd5223450 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-887f04a7-366a-452a-8763-228150317fc2-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-56a5eeda-49d3-4623-9fb5-529dd5223450 tempest-ProjectMemberTests-322461420 None] Lock "cinder-887f04a7-366a-452a-8763-228150317fc2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-56a5eeda-49d3-4623-9fb5-529dd5223450 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-quobyte-915b07a7-254c-443d-a746-aa500b738292" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-56a5eeda-49d3-4623-9fb5-529dd5223450 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-915b07a7-254c-443d-a746-aa500b738292" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-56a5eeda-49d3-4623-9fb5-529dd5223450 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-quobyte-887f04a7-366a-452a-8763-228150317fc2" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:31 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-56a5eeda-49d3-4623-9fb5-529dd5223450 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-887f04a7-366a-452a-8763-228150317fc2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:31 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-56a5eeda-49d3-4623-9fb5-529dd5223450 tempest-ProjectMemberTests-322461420 None] Deleting offline snapshot 887f04a7-366a-452a-8763-228150317fc2 of volume 915b07a7-254c-443d-a746-aa500b738292 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:08:31 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-56a5eeda-49d3-4623-9fb5-529dd5223450 tempest-ProjectMemberTests-322461420 None] snapshot_file for this snap is: volume-915b07a7-254c-443d-a746-aa500b738292.887f04a7-366a-452a-8763-228150317fc2 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:08:31 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5e3d53-0d91-4055-aedd-2d63daa34732]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-56a5eeda-49d3-4623-9fb5-529dd5223450 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292.887f04a7-366a-452a-8763-228150317fc2 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:31 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292.887f04a7-366a-452a-8763-228150317fc2 Sep 04 16:08:31 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:31 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-56a5eeda-49d3-4623-9fb5-529dd5223450 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292.887f04a7-366a-452a-8763-228150317fc2" returned: 0 in 0.399s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:31 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-56a5eeda-49d3-4623-9fb5-529dd5223450 tempest-ProjectMemberTests-322461420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-915b07a7-254c-443d-a746-aa500b738292(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:08:31 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fab334f-4958-45af-972f-b76bb4e2f89f]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:31 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-56a5eeda-49d3-4623-9fb5-529dd5223450 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:31 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292 Sep 04 16:08:31 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:32 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-56a5eeda-49d3-4623-9fb5-529dd5223450 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292" returned: 0 in 0.359s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-56a5eeda-49d3-4623-9fb5-529dd5223450 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292.887f04a7-366a-452a-8763-228150317fc2 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:32 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292.887f04a7-366a-452a-8763-228150317fc2 Sep 04 16:08:32 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:32 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-56a5eeda-49d3-4623-9fb5-529dd5223450 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292.887f04a7-366a-452a-8763-228150317fc2" returned: 0 in 0.347s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-56a5eeda-49d3-4623-9fb5-529dd5223450 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292.887f04a7-366a-452a-8763-228150317fc2 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:32 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292.887f04a7-366a-452a-8763-228150317fc2 Sep 04 16:08:32 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:32 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:32 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-56a5eeda-49d3-4623-9fb5-529dd5223450 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292.887f04a7-366a-452a-8763-228150317fc2" returned: 0 in 0.256s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-56a5eeda-49d3-4623-9fb5-529dd5223450 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-887f04a7-366a-452a-8763-228150317fc2" released by "_delete_snapshot" :: held 1.461s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-56a5eeda-49d3-4623-9fb5-529dd5223450 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-915b07a7-254c-443d-a746-aa500b738292" released by "delete_snapshot" :: held 1.490s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:32 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=160,cinder:INSERT=61,cinder:UPDATE=234,cinder:DELETE=18 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:08:32 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-56a5eeda-49d3-4623-9fb5-529dd5223450 tempest-ProjectMemberTests-322461420 None] Created reservations ['58140612-b314-4ec0-806e-e10a7a2aa8b2', '5ca7da21-9f8d-41b4-b391-f51be921a614', '3f747648-823a-4f4d-b676-98fe4d7f40b5', 'c2b62a40-4793-43dc-aba8-1bf9aabe74a0'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:08:32 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-56a5eeda-49d3-4623-9fb5-529dd5223450 tempest-ProjectMemberTests-322461420 None] Delete snapshot completed successfully. Sep 04 16:08:32 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-56a5eeda-49d3-4623-9fb5-529dd5223450 tempest-ProjectMemberTests-322461420 None] Lock "cinder-887f04a7-366a-452a-8763-228150317fc2-delete_snapshot" released by "delete_snapshot" :: held 1.649s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:33 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-efc0c218-3783-4145-8009-c5c54f267929 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-915b07a7-254c-443d-a746-aa500b738292-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:33 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-efc0c218-3783-4145-8009-c5c54f267929 tempest-ProjectMemberTests-322461420 None] Lock "cinder-915b07a7-254c-443d-a746-aa500b738292-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:33 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-efc0c218-3783-4145-8009-c5c54f267929 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-quobyte-915b07a7-254c-443d-a746-aa500b738292" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:33 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-efc0c218-3783-4145-8009-c5c54f267929 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-915b07a7-254c-443d-a746-aa500b738292" acquired by "delete_volume" :: waited 0.014s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:33 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae730af-e984-4b10-a239-c44552e1aade]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-efc0c218-3783-4145-8009-c5c54f267929 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:33 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292 Sep 04 16:08:33 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:33 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-efc0c218-3783-4145-8009-c5c54f267929 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292" returned: 0 in 0.352s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:33 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-efc0c218-3783-4145-8009-c5c54f267929 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:33 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292 Sep 04 16:08:33 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:34 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-efc0c218-3783-4145-8009-c5c54f267929 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-915b07a7-254c-443d-a746-aa500b738292" returned: 0 in 0.240s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-efc0c218-3783-4145-8009-c5c54f267929 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-915b07a7-254c-443d-a746-aa500b738292" released by "delete_volume" :: held 0.650s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-efc0c218-3783-4145-8009-c5c54f267929 tempest-ProjectMemberTests-322461420 None] Created reservations ['a9cade18-84a7-4853-95bc-14146657b77e', '0dd41b80-4ad9-4e2d-8a14-84f0764c85a7', 'f47f5683-7707-496d-bfb9-0106e286f82d', 'e159756a-70d5-4afd-9303-7b9c59745eb5'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-efc0c218-3783-4145-8009-c5c54f267929 tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-efc0c218-3783-4145-8009-c5c54f267929 tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-efc0c218-3783-4145-8009-c5c54f267929 tempest-ProjectMemberTests-322461420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-efc0c218-3783-4145-8009-c5c54f267929 tempest-ProjectMemberTests-322461420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-efc0c218-3783-4145-8009-c5c54f267929 tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-efc0c218-3783-4145-8009-c5c54f267929 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:34 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:08:34 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:34 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-efc0c218-3783-4145-8009-c5c54f267929 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.241s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-efc0c218-3783-4145-8009-c5c54f267929 tempest-ProjectMemberTests-322461420 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:08:34 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-efc0c218-3783-4145-8009-c5c54f267929 tempest-ProjectMemberTests-322461420 None] Deleted volume successfully. Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-efc0c218-3783-4145-8009-c5c54f267929 tempest-ProjectMemberTests-322461420 None] Lock "cinder-915b07a7-254c-443d-a746-aa500b738292-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Flow 'volume_create_manager' (ac4928d8-0574-4bd1-8175-53ee67f86605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae6072bb-5dc6-4b63-999b-bdd2e5febfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae6072bb-5dc6-4b63-999b-bdd2e5febfb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-875595321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4263b0b-860a-4cd4-97f7-4e575a59673d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67dc993fc9ce4300852a9f87ee1ded6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:35Z,use_quota=True,user_id='862f7e66540c4c5baa32a03cb34b0c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a044dc17-8d7e-4475-9295-f2f573293aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a044dc17-8d7e-4475-9295-f2f573293aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79bf16ec-0fd9-47cd-8ca0-3714a4c8ed6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79bf16ec-0fd9-47cd-8ca0-3714a4c8ed6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4263b0b-860a-4cd4-97f7-4e575a59673d', 'volume_name': 'volume-f4263b0b-860a-4cd4-97f7-4e575a59673d', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f903f9-11ab-4d82-9f76-3e30de743cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f903f9-11ab-4d82-9f76-3e30de743cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c36a430d-23b4-4730-8f36-a11c533e5ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:34 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Volume f4263b0b-860a-4cd4-97f7-4e575a59673d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4263b0b-860a-4cd4-97f7-4e575a59673d', 'volume_size': 1} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-875595321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4263b0b-860a-4cd4-97f7-4e575a59673d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67dc993fc9ce4300852a9f87ee1ded6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:08:35Z,use_quota=True,user_id='862f7e66540c4c5baa32a03cb34b0c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Creating volume f4263b0b-860a-4cd4-97f7-4e575a59673d {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:08:34 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:08:34 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:34 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d 1073741824 Sep 04 16:08:34 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:35 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d 1073741824" returned: 0 in 0.402s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:35 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d Sep 04 16:08:35 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:35 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d" returned: 0 in 0.225s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:35 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:08:35 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c36a430d-23b4-4730-8f36-a11c533e5ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4263b0b-860a-4cd4-97f7-4e575a59673d', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa19f03-40ff-41bc-b8b4-9108717742b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:08:35 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Volume volume-f4263b0b-860a-4cd4-97f7-4e575a59673d (f4263b0b-860a-4cd4-97f7-4e575a59673d): created successfully Sep 04 16:08:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa19f03-40ff-41bc-b8b4-9108717742b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:08:35 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Flow 'volume_create_manager' (ac4928d8-0574-4bd1-8175-53ee67f86605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:08:35 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-bf994f55-d3cd-4140-ae65-bd7de1b162e7 tempest-ProjectMemberTests-322461420 None] Created volume successfully. Sep 04 16:08:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4ef743fc-710d-4971-98cf-2e8077af400b tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4ef743fc-710d-4971-98cf-2e8077af400b tempest-ProjectMemberTests-322461420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:36 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-4ef743fc-710d-4971-98cf-2e8077af400b tempest-ProjectMemberTests-322461420 None] Creating offline snapshot d581064a-f6f8-4b9b-b849-622a183a113e of volume f4263b0b-860a-4cd4-97f7-4e575a59673d {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:08:36 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ccb895-06ca-4ab8-a589-700ad7617384]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ef743fc-710d-4971-98cf-2e8077af400b tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:36 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d Sep 04 16:08:36 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:36 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ef743fc-710d-4971-98cf-2e8077af400b tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d" returned: 0 in 0.336s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ef743fc-710d-4971-98cf-2e8077af400b tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d.d581064a-f6f8-4b9b-b849-622a183a113e 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:36 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d.d581064a-f6f8-4b9b-b849-622a183a113e 1G Sep 04 16:08:36 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:36 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ef743fc-710d-4971-98cf-2e8077af400b tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d.d581064a-f6f8-4b9b-b849-622a183a113e 1G" returned: 0 in 0.385s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:36 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ef743fc-710d-4971-98cf-2e8077af400b tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4263b0b-860a-4cd4-97f7-4e575a59673d -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d.d581064a-f6f8-4b9b-b849-622a183a113e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:36 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4263b0b-860a-4cd4-97f7-4e575a59673d -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d.d581064a-f6f8-4b9b-b849-622a183a113e Sep 04 16:08:36 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:37 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ef743fc-710d-4971-98cf-2e8077af400b tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4263b0b-860a-4cd4-97f7-4e575a59673d -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d.d581064a-f6f8-4b9b-b849-622a183a113e" returned: 0 in 0.271s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:37 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-4ef743fc-710d-4971-98cf-2e8077af400b tempest-ProjectMemberTests-322461420 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d.d581064a-f6f8-4b9b-b849-622a183a113e is being set with open permissions: ugo+rw Sep 04 16:08:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ef743fc-710d-4971-98cf-2e8077af400b tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d.d581064a-f6f8-4b9b-b849-622a183a113e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:37 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d.d581064a-f6f8-4b9b-b849-622a183a113e Sep 04 16:08:37 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:37 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ef743fc-710d-4971-98cf-2e8077af400b tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d.d581064a-f6f8-4b9b-b849-622a183a113e" returned: 0 in 0.228s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ef743fc-710d-4971-98cf-2e8077af400b tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:37 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d.info Sep 04 16:08:37 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:37 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ef743fc-710d-4971-98cf-2e8077af400b tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d.info" returned: 0 in 0.231s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:37 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-4ef743fc-710d-4971-98cf-2e8077af400b tempest-ProjectMemberTests-322461420 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d.info is being set with open permissions: ugo+rw Sep 04 16:08:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ef743fc-710d-4971-98cf-2e8077af400b tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:37 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d.info Sep 04 16:08:37 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:37 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4ef743fc-710d-4971-98cf-2e8077af400b tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d.info" returned: 0 in 0.237s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:37 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-4ef743fc-710d-4971-98cf-2e8077af400b tempest-ProjectMemberTests-322461420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.756s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:37 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-4ef743fc-710d-4971-98cf-2e8077af400b tempest-ProjectMemberTests-322461420 None] Create snapshot completed successfully Sep 04 16:08:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:08:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:08:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:08:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:38 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:08:38 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:38 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4a6ca7b8-b07d-4640-8598-630415e383d7 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-d581064a-f6f8-4b9b-b849-622a183a113e-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:38 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4a6ca7b8-b07d-4640-8598-630415e383d7 tempest-ProjectMemberTests-322461420 None] Lock "cinder-d581064a-f6f8-4b9b-b849-622a183a113e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:38 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4a6ca7b8-b07d-4640-8598-630415e383d7 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-quobyte-f4263b0b-860a-4cd4-97f7-4e575a59673d" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:38 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4a6ca7b8-b07d-4640-8598-630415e383d7 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-f4263b0b-860a-4cd4-97f7-4e575a59673d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:38 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4a6ca7b8-b07d-4640-8598-630415e383d7 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-quobyte-d581064a-f6f8-4b9b-b849-622a183a113e" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:38 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4a6ca7b8-b07d-4640-8598-630415e383d7 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-d581064a-f6f8-4b9b-b849-622a183a113e" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-4a6ca7b8-b07d-4640-8598-630415e383d7 tempest-ProjectMemberTests-322461420 None] Deleting offline snapshot d581064a-f6f8-4b9b-b849-622a183a113e of volume f4263b0b-860a-4cd4-97f7-4e575a59673d {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:08:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-4a6ca7b8-b07d-4640-8598-630415e383d7 tempest-ProjectMemberTests-322461420 None] snapshot_file for this snap is: volume-f4263b0b-860a-4cd4-97f7-4e575a59673d.d581064a-f6f8-4b9b-b849-622a183a113e {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:08:38 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[352830d0-34c8-4a1e-96ce-f1c11a06b6b0]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4a6ca7b8-b07d-4640-8598-630415e383d7 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d.d581064a-f6f8-4b9b-b849-622a183a113e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:38 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d.d581064a-f6f8-4b9b-b849-622a183a113e Sep 04 16:08:38 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:38 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.260s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:38 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:08:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager._thread_info {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:08:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread count: 29 {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 16:08:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread info: [<_MainThread(MainThread, started 138899118923904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 16:08:38 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4a6ca7b8-b07d-4640-8598-630415e383d7 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d.d581064a-f6f8-4b9b-b849-622a183a113e" returned: 0 in 0.341s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-4a6ca7b8-b07d-4640-8598-630415e383d7 tempest-ProjectMemberTests-322461420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4263b0b-860a-4cd4-97f7-4e575a59673d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:08:38 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf044c7-291e-4755-8f6d-d1b4900ce145]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4a6ca7b8-b07d-4640-8598-630415e383d7 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:38 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d Sep 04 16:08:38 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:39 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4a6ca7b8-b07d-4640-8598-630415e383d7 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d" returned: 0 in 0.329s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4a6ca7b8-b07d-4640-8598-630415e383d7 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d.d581064a-f6f8-4b9b-b849-622a183a113e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:39 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d.d581064a-f6f8-4b9b-b849-622a183a113e Sep 04 16:08:39 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:39 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4a6ca7b8-b07d-4640-8598-630415e383d7 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d.d581064a-f6f8-4b9b-b849-622a183a113e" returned: 0 in 0.312s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4a6ca7b8-b07d-4640-8598-630415e383d7 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d.d581064a-f6f8-4b9b-b849-622a183a113e {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:39 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d.d581064a-f6f8-4b9b-b849-622a183a113e Sep 04 16:08:39 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:39 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:39 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-4a6ca7b8-b07d-4640-8598-630415e383d7 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d.d581064a-f6f8-4b9b-b849-622a183a113e" returned: 0 in 0.236s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:39 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4a6ca7b8-b07d-4640-8598-630415e383d7 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-d581064a-f6f8-4b9b-b849-622a183a113e" released by "_delete_snapshot" :: held 1.313s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:39 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4a6ca7b8-b07d-4640-8598-630415e383d7 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-f4263b0b-860a-4cd4-97f7-4e575a59673d" released by "delete_snapshot" :: held 1.335s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:39 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-4a6ca7b8-b07d-4640-8598-630415e383d7 tempest-ProjectMemberTests-322461420 None] Created reservations ['5fe87470-0091-4515-9b30-7adb34ffba00', 'f5b15921-a71d-47de-92e9-a10232b33933', '71ef58fa-22f7-4677-9890-3e41d4b9bf79', 'c0f10780-f4e5-44be-b550-b52f5b902534'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:08:39 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-4a6ca7b8-b07d-4640-8598-630415e383d7 tempest-ProjectMemberTests-322461420 None] Delete snapshot completed successfully. Sep 04 16:08:39 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-4a6ca7b8-b07d-4640-8598-630415e383d7 tempest-ProjectMemberTests-322461420 None] Lock "cinder-d581064a-f6f8-4b9b-b849-622a183a113e-delete_snapshot" released by "delete_snapshot" :: held 1.467s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-8400f676-8da8-4768-a111-753cebe88186 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-f4263b0b-860a-4cd4-97f7-4e575a59673d-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-8400f676-8da8-4768-a111-753cebe88186 tempest-ProjectMemberTests-322461420 None] Lock "cinder-f4263b0b-860a-4cd4-97f7-4e575a59673d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-8400f676-8da8-4768-a111-753cebe88186 tempest-ProjectMemberTests-322461420 None] Acquiring lock "cinder-quobyte-f4263b0b-860a-4cd4-97f7-4e575a59673d" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:08:40 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-8400f676-8da8-4768-a111-753cebe88186 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-f4263b0b-860a-4cd4-97f7-4e575a59673d" acquired by "delete_volume" :: waited 0.015s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:08:40 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d005357-d8c8-433f-9343-fd085ff65820]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:08:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8400f676-8da8-4768-a111-753cebe88186 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:40 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d Sep 04 16:08:40 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:40 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8400f676-8da8-4768-a111-753cebe88186 tempest-ProjectMemberTests-322461420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d" returned: 0 in 0.341s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:40 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8400f676-8da8-4768-a111-753cebe88186 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:40 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d Sep 04 16:08:40 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:41 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8400f676-8da8-4768-a111-753cebe88186 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-f4263b0b-860a-4cd4-97f7-4e575a59673d" returned: 0 in 0.238s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:41 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-8400f676-8da8-4768-a111-753cebe88186 tempest-ProjectMemberTests-322461420 None] Lock "cinder-quobyte-f4263b0b-860a-4cd4-97f7-4e575a59673d" released by "delete_volume" :: held 0.633s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:41 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-8400f676-8da8-4768-a111-753cebe88186 tempest-ProjectMemberTests-322461420 None] Created reservations ['7f8cb389-c551-4e0a-a2d5-f913291c40f8', 'e2b02b82-6098-493d-b9a4-724497600761', 'ee625c26-a45d-4be3-b71b-62a9ba1947e9', '638de253-a62d-4ce4-9093-234b10e71eee'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:08:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8400f676-8da8-4768-a111-753cebe88186 tempest-ProjectMemberTests-322461420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:08:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8400f676-8da8-4768-a111-753cebe88186 tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:08:41 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-8400f676-8da8-4768-a111-753cebe88186 tempest-ProjectMemberTests-322461420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:08:41 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-8400f676-8da8-4768-a111-753cebe88186 tempest-ProjectMemberTests-322461420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:08:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-8400f676-8da8-4768-a111-753cebe88186 tempest-ProjectMemberTests-322461420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:08:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8400f676-8da8-4768-a111-753cebe88186 tempest-ProjectMemberTests-322461420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:08:41 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:08:41 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:08:41 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Sep 04 16:08:41 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-8400f676-8da8-4768-a111-753cebe88186 tempest-ProjectMemberTests-322461420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.250s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:08:41 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-8400f676-8da8-4768-a111-753cebe88186 tempest-ProjectMemberTests-322461420 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:08:41 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-8400f676-8da8-4768-a111-753cebe88186 tempest-ProjectMemberTests-322461420 None] Deleted volume successfully. Sep 04 16:08:41 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-8400f676-8da8-4768-a111-753cebe88186 tempest-ProjectMemberTests-322461420 None] Lock "cinder-f4263b0b-860a-4cd4-97f7-4e575a59673d-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:08:51 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=26,cinder:INSERT=8,cinder:UPDATE=30 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:08:51 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=20,cinder:INSERT=10,cinder:UPDATE=33,cinder:DELETE=4 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Flow 'volume_create_manager' (168cda09-3dad-4397-ae8c-3fea16b531dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56371832-3cb9-44b4-aae7-2a977b399059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56371832-3cb9-44b4-aae7-2a977b399059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-61614141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b96b30-8a77-4909-804c-5247dbfc7347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7a6553dac9a481fb1206e6ba3b533c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:10Z,use_quota=True,user_id='8e9b9ac396694c7997666b2a298bd923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5e2230-14f8-468e-95b5-8e859aa0e956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5e2230-14f8-468e-95b5-8e859aa0e956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b882d3-6001-48d0-8262-8dd73a66d76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b882d3-6001-48d0-8262-8dd73a66d76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01b96b30-8a77-4909-804c-5247dbfc7347', 'volume_name': 'volume-01b96b30-8a77-4909-804c-5247dbfc7347', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b566328-f751-42bd-8d32-cc6edf7d8b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b566328-f751-42bd-8d32-cc6edf7d8b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0a44eb-2c30-4f8e-89c5-568c752bce62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:10 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Volume 01b96b30-8a77-4909-804c-5247dbfc7347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01b96b30-8a77-4909-804c-5247dbfc7347', 'volume_size': 1} Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-61614141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b96b30-8a77-4909-804c-5247dbfc7347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7a6553dac9a481fb1206e6ba3b533c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:10Z,use_quota=True,user_id='8e9b9ac396694c7997666b2a298bd923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)}" {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Creating volume 01b96b30-8a77-4909-804c-5247dbfc7347 {{(pid=87490) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:09:10 devstack cinder-volume[87490]: INFO cinder.volume.drivers.remotefs [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] casted to osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347 1073741824 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:10 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347 1073741824 Sep 04 16:09:10 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:10 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347 1073741824" returned: 0 in 0.404s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:10 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347 Sep 04 16:09:10 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:10 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347" returned: 0 in 0.235s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'} {{(pid=87490) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0a44eb-2c30-4f8e-89c5-568c752bce62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01b96b30-8a77-4909-804c-5247dbfc7347', 'volume_size': 1}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3270d8ed-d81e-4571-b70f-c7e55695c304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:10 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Volume volume-01b96b30-8a77-4909-804c-5247dbfc7347 (01b96b30-8a77-4909-804c-5247dbfc7347): created successfully Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3270d8ed-d81e-4571-b70f-c7e55695c304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:10 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Flow 'volume_create_manager' (168cda09-3dad-4397-ae8c-3fea16b531dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:10 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-3556de0e-158e-4e8e-9a0a-760033227171 tempest-SnapshotDependencyTests-324194083 None] Created volume successfully. Sep 04 16:09:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-44ce2a49-6a3a-4957-aaf4-8e45f01acc8c tempest-SnapshotDependencyTests-324194083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-44ce2a49-6a3a-4957-aaf4-8e45f01acc8c tempest-SnapshotDependencyTests-324194083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:11 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-44ce2a49-6a3a-4957-aaf4-8e45f01acc8c tempest-SnapshotDependencyTests-324194083 None] Creating offline snapshot bb2ee425-2d44-4350-ba7f-d242be7900b6 of volume 01b96b30-8a77-4909-804c-5247dbfc7347 {{(pid=87490) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 16:09:11 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[081e1780-dcfd-41af-ae0f-221625ed10e2]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-44ce2a49-6a3a-4957-aaf4-8e45f01acc8c tempest-SnapshotDependencyTests-324194083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:11 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347 Sep 04 16:09:11 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:11 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-44ce2a49-6a3a-4957-aaf4-8e45f01acc8c tempest-SnapshotDependencyTests-324194083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347" returned: 0 in 0.351s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:11 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-44ce2a49-6a3a-4957-aaf4-8e45f01acc8c tempest-SnapshotDependencyTests-324194083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.bb2ee425-2d44-4350-ba7f-d242be7900b6 1G {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:11 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.bb2ee425-2d44-4350-ba7f-d242be7900b6 1G Sep 04 16:09:11 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:12 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-44ce2a49-6a3a-4957-aaf4-8e45f01acc8c tempest-SnapshotDependencyTests-324194083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.bb2ee425-2d44-4350-ba7f-d242be7900b6 1G" returned: 0 in 0.381s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-44ce2a49-6a3a-4957-aaf4-8e45f01acc8c tempest-SnapshotDependencyTests-324194083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b96b30-8a77-4909-804c-5247dbfc7347 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.bb2ee425-2d44-4350-ba7f-d242be7900b6 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:12 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b96b30-8a77-4909-804c-5247dbfc7347 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.bb2ee425-2d44-4350-ba7f-d242be7900b6 Sep 04 16:09:12 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:12 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-44ce2a49-6a3a-4957-aaf4-8e45f01acc8c tempest-SnapshotDependencyTests-324194083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b96b30-8a77-4909-804c-5247dbfc7347 -F qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.bb2ee425-2d44-4350-ba7f-d242be7900b6" returned: 0 in 0.280s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:12 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-44ce2a49-6a3a-4957-aaf4-8e45f01acc8c tempest-SnapshotDependencyTests-324194083 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.bb2ee425-2d44-4350-ba7f-d242be7900b6 is being set with open permissions: ugo+rw Sep 04 16:09:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-44ce2a49-6a3a-4957-aaf4-8e45f01acc8c tempest-SnapshotDependencyTests-324194083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.bb2ee425-2d44-4350-ba7f-d242be7900b6 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:12 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.bb2ee425-2d44-4350-ba7f-d242be7900b6 Sep 04 16:09:12 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:12 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-44ce2a49-6a3a-4957-aaf4-8e45f01acc8c tempest-SnapshotDependencyTests-324194083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.bb2ee425-2d44-4350-ba7f-d242be7900b6" returned: 0 in 0.248s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-44ce2a49-6a3a-4957-aaf4-8e45f01acc8c tempest-SnapshotDependencyTests-324194083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:12 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.info Sep 04 16:09:12 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:12 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-44ce2a49-6a3a-4957-aaf4-8e45f01acc8c tempest-SnapshotDependencyTests-324194083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.info" returned: 0 in 0.239s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:12 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-44ce2a49-6a3a-4957-aaf4-8e45f01acc8c tempest-SnapshotDependencyTests-324194083 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.info is being set with open permissions: ugo+rw Sep 04 16:09:12 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-44ce2a49-6a3a-4957-aaf4-8e45f01acc8c tempest-SnapshotDependencyTests-324194083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.info {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:12 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.info Sep 04 16:09:12 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:13 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-44ce2a49-6a3a-4957-aaf4-8e45f01acc8c tempest-SnapshotDependencyTests-324194083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.info" returned: 0 in 0.226s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:13 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-44ce2a49-6a3a-4957-aaf4-8e45f01acc8c tempest-SnapshotDependencyTests-324194083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.806s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:13 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-44ce2a49-6a3a-4957-aaf4-8e45f01acc8c tempest-SnapshotDependencyTests-324194083 None] Create snapshot completed successfully Sep 04 16:09:13 devstack cinder-volume[87490]: DEBUG cinder.volume.flows.manager.create_volume [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87490) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 16:09:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Flow 'volume_create_manager' (e920bc83-97ec-4be8-b8ae-d8c85d531e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:13 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba55d4c-9643-4945-95f5-197a609a31d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba55d4c-9643-4945-95f5-197a609a31d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T14:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3938cef6-1f9e-450c-9e6a-0f0454199adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7a6553dac9a481fb1206e6ba3b533c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T14:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bb2ee425-2d44-4350-ba7f-d242be7900b6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T14:09:14Z,use_quota=True,user_id='8e9b9ac396694c7997666b2a298bd923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1813afa0-667c-4135-8713-9444e9bd4f7c),volume_type_id=1813afa0-667c-4135-8713-9444e9bd4f7c)' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4837bf29-46af-45f9-b66c-80dfe122bbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4837bf29-46af-45f9-b66c-80dfe122bbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ebaf979-c2da-4a2a-bf83-ab69809975d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ebaf979-c2da-4a2a-bf83-ab69809975d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3938cef6-1f9e-450c-9e6a-0f0454199adc', 'volume_name': 'volume-3938cef6-1f9e-450c-9e6a-0f0454199adc', 'volume_size': 1, 'snapshot_id': 'bb2ee425-2d44-4350-ba7f-d242be7900b6'}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59a2b7b2-4bce-4012-b5d6-86474d35e01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59a2b7b2-4bce-4012-b5d6-86474d35e01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd628b24-8bfc-4a94-830f-069d4e31f790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:14 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Volume 3938cef6-1f9e-450c-9e6a-0f0454199adc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3938cef6-1f9e-450c-9e6a-0f0454199adc', 'volume_size': 1, 'snapshot_id': 'bb2ee425-2d44-4350-ba7f-d242be7900b6'} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Acquiring lock "cinder-quobyte-bb2ee425-2d44-4350-ba7f-d242be7900b6-3938cef6-1f9e-450c-9e6a-0f0454199adc" by "_create_volume_from_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Lock "cinder-quobyte-bb2ee425-2d44-4350-ba7f-d242be7900b6-3938cef6-1f9e-450c-9e6a-0f0454199adc" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Creating volume 3938cef6-1f9e-450c-9e6a-0f0454199adc from snapshot bb2ee425-2d44-4350-ba7f-d242be7900b6 {{(pid=87490) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Selected osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787 as target Quobyte volume. {{(pid=87490) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Acquiring lock "cinder-quobyte-3938cef6-1f9e-450c-9e6a-0f0454199adc" by "_copy_volume_from_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Lock "cinder-quobyte-3938cef6-1f9e-450c-9e6a-0f0454199adc" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] snapshot: bb2ee425-2d44-4350-ba7f-d242be7900b6, volume: 3938cef6-1f9e-450c-9e6a-0f0454199adc, {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8d3c5f-7648-4158-89bb-ed29309301af]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.bb2ee425-2d44-4350-ba7f-d242be7900b6 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:14 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.bb2ee425-2d44-4350-ba7f-d242be7900b6 Sep 04 16:09:14 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:14 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.bb2ee425-2d44-4350-ba7f-d242be7900b6" returned: 0 in 0.344s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01b96b30-8a77-4909-804c-5247dbfc7347(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d99ef3-fc4e-4567-a4a4-8b866c065951]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:14 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347 Sep 04 16:09:14 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:14 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347" returned: 0 in 0.337s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347 {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Creating direct copy from snapshot {{(pid=87490) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG cinder.utils [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Path /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3938cef6-1f9e-450c-9e6a-0f0454199adc not found in is_blk_device check {{(pid=87490) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 16:09:14 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3938cef6-1f9e-450c-9e6a-0f0454199adc {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:14 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3938cef6-1f9e-450c-9e6a-0f0454199adc Sep 04 16:09:14 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:18 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3938cef6-1f9e-450c-9e6a-0f0454199adc" returned: 0 in 3.885s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:18 devstack cinder-volume[87490]: DEBUG cinder.image.image_utils [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Image conversion details: src /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347, size 1024.00 MB, duration 3.89 sec, destination /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3938cef6-1f9e-450c-9e6a-0f0454199adc {{(pid=87490) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 16:09:18 devstack cinder-volume[87490]: INFO cinder.image.image_utils [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Converted 1024.00 MB image at 263.53 MB/s Sep 04 16:09:18 devstack cinder-volume[87490]: WARNING cinder.volume.drivers.remotefs [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3938cef6-1f9e-450c-9e6a-0f0454199adc is being set with open permissions: ugo+rw Sep 04 16:09:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3938cef6-1f9e-450c-9e6a-0f0454199adc {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:18 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3938cef6-1f9e-450c-9e6a-0f0454199adc Sep 04 16:09:18 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:18 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:18 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3938cef6-1f9e-450c-9e6a-0f0454199adc" returned: 0 in 0.227s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:18 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Lock "cinder-quobyte-3938cef6-1f9e-450c-9e6a-0f0454199adc" released by "_copy_volume_from_snapshot" :: held 4.862s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Lock "cinder-quobyte-bb2ee425-2d44-4350-ba7f-d242be7900b6-3938cef6-1f9e-450c-9e6a-0f0454199adc" released by "_create_volume_from_snapshot" :: held 4.924s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.938s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd628b24-8bfc-4a94-830f-069d4e31f790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3938cef6-1f9e-450c-9e6a-0f0454199adc', 'volume_size': 1, 'snapshot_id': 'bb2ee425-2d44-4350-ba7f-d242be7900b6'}' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f675e7-359e-4126-8f61-e68f96c37222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 16:09:19 devstack cinder-volume[87490]: INFO cinder.volume.flows.manager.create_volume [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Volume volume-3938cef6-1f9e-450c-9e6a-0f0454199adc (3938cef6-1f9e-450c-9e6a-0f0454199adc): created successfully Sep 04 16:09:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f675e7-359e-4126-8f61-e68f96c37222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87490) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 16:09:19 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Flow 'volume_create_manager' (e920bc83-97ec-4be8-b8ae-d8c85d531e88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87490) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 16:09:19 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-b879394e-5ad4-46fa-bfe8-a3c7d19496cf tempest-SnapshotDependencyTests-324194083 None] Created volume successfully. Sep 04 16:09:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a50f0195-8339-4048-b0e2-752f4ddeb4d2 tempest-SnapshotDependencyTests-324194083 None] Acquiring lock "cinder-bb2ee425-2d44-4350-ba7f-d242be7900b6-delete_snapshot" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a50f0195-8339-4048-b0e2-752f4ddeb4d2 tempest-SnapshotDependencyTests-324194083 None] Lock "cinder-bb2ee425-2d44-4350-ba7f-d242be7900b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a50f0195-8339-4048-b0e2-752f4ddeb4d2 tempest-SnapshotDependencyTests-324194083 None] Acquiring lock "cinder-quobyte-01b96b30-8a77-4909-804c-5247dbfc7347" by "delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a50f0195-8339-4048-b0e2-752f4ddeb4d2 tempest-SnapshotDependencyTests-324194083 None] Lock "cinder-quobyte-01b96b30-8a77-4909-804c-5247dbfc7347" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a50f0195-8339-4048-b0e2-752f4ddeb4d2 tempest-SnapshotDependencyTests-324194083 None] Acquiring lock "cinder-quobyte-bb2ee425-2d44-4350-ba7f-d242be7900b6" by "_delete_snapshot" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:19 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a50f0195-8339-4048-b0e2-752f4ddeb4d2 tempest-SnapshotDependencyTests-324194083 None] Lock "cinder-quobyte-bb2ee425-2d44-4350-ba7f-d242be7900b6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-a50f0195-8339-4048-b0e2-752f4ddeb4d2 tempest-SnapshotDependencyTests-324194083 None] Deleting offline snapshot bb2ee425-2d44-4350-ba7f-d242be7900b6 of volume 01b96b30-8a77-4909-804c-5247dbfc7347 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 16:09:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-a50f0195-8339-4048-b0e2-752f4ddeb4d2 tempest-SnapshotDependencyTests-324194083 None] snapshot_file for this snap is: volume-01b96b30-8a77-4909-804c-5247dbfc7347.bb2ee425-2d44-4350-ba7f-d242be7900b6 {{(pid=87490) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 16:09:19 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef68729-8215-4abb-9597-257b788888e7]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a50f0195-8339-4048-b0e2-752f4ddeb4d2 tempest-SnapshotDependencyTests-324194083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.bb2ee425-2d44-4350-ba7f-d242be7900b6 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:19 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.bb2ee425-2d44-4350-ba7f-d242be7900b6 Sep 04 16:09:19 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:19 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:19 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a50f0195-8339-4048-b0e2-752f4ddeb4d2 tempest-SnapshotDependencyTests-324194083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.bb2ee425-2d44-4350-ba7f-d242be7900b6" returned: 0 in 0.389s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:19 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.remotefs [None req-a50f0195-8339-4048-b0e2-752f4ddeb4d2 tempest-SnapshotDependencyTests-324194083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01b96b30-8a77-4909-804c-5247dbfc7347(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87490) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 16:09:20 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[acad20e5-8d25-4e58-8918-56e5aabe71ce]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a50f0195-8339-4048-b0e2-752f4ddeb4d2 tempest-SnapshotDependencyTests-324194083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:20 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347 Sep 04 16:09:20 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:20 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a50f0195-8339-4048-b0e2-752f4ddeb4d2 tempest-SnapshotDependencyTests-324194083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347" returned: 0 in 0.537s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a50f0195-8339-4048-b0e2-752f4ddeb4d2 tempest-SnapshotDependencyTests-324194083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.bb2ee425-2d44-4350-ba7f-d242be7900b6 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:20 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.bb2ee425-2d44-4350-ba7f-d242be7900b6 Sep 04 16:09:20 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:20 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a50f0195-8339-4048-b0e2-752f4ddeb4d2 tempest-SnapshotDependencyTests-324194083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.bb2ee425-2d44-4350-ba7f-d242be7900b6" returned: 0 in 0.328s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:20 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a50f0195-8339-4048-b0e2-752f4ddeb4d2 tempest-SnapshotDependencyTests-324194083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.bb2ee425-2d44-4350-ba7f-d242be7900b6 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:20 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.bb2ee425-2d44-4350-ba7f-d242be7900b6 Sep 04 16:09:20 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:21 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-a50f0195-8339-4048-b0e2-752f4ddeb4d2 tempest-SnapshotDependencyTests-324194083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347.bb2ee425-2d44-4350-ba7f-d242be7900b6" returned: 0 in 0.245s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a50f0195-8339-4048-b0e2-752f4ddeb4d2 tempest-SnapshotDependencyTests-324194083 None] Lock "cinder-quobyte-bb2ee425-2d44-4350-ba7f-d242be7900b6" released by "_delete_snapshot" :: held 1.613s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a50f0195-8339-4048-b0e2-752f4ddeb4d2 tempest-SnapshotDependencyTests-324194083 None] Lock "cinder-quobyte-01b96b30-8a77-4909-804c-5247dbfc7347" released by "delete_snapshot" :: held 1.646s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:21 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-a50f0195-8339-4048-b0e2-752f4ddeb4d2 tempest-SnapshotDependencyTests-324194083 None] Created reservations ['04db987b-193e-4aea-be10-3b9cb07fbf97', '1b334d74-d7bc-49a5-99d7-7a4b82d2979c', '3e3d8aae-edf0-4a4a-b4c1-2767b7cd5312', '7ef9629d-52c3-4ed4-8003-8aa23d0ba817'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:09:21 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-a50f0195-8339-4048-b0e2-752f4ddeb4d2 tempest-SnapshotDependencyTests-324194083 None] Delete snapshot completed successfully. Sep 04 16:09:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-a50f0195-8339-4048-b0e2-752f4ddeb4d2 tempest-SnapshotDependencyTests-324194083 None] Lock "cinder-bb2ee425-2d44-4350-ba7f-d242be7900b6-delete_snapshot" released by "delete_snapshot" :: held 1.797s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2e7bcdf2-9f70-4207-9e03-91a805ceabe6 tempest-SnapshotDependencyTests-324194083 None] Acquiring lock "cinder-01b96b30-8a77-4909-804c-5247dbfc7347-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2e7bcdf2-9f70-4207-9e03-91a805ceabe6 tempest-SnapshotDependencyTests-324194083 None] Lock "cinder-01b96b30-8a77-4909-804c-5247dbfc7347-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2e7bcdf2-9f70-4207-9e03-91a805ceabe6 tempest-SnapshotDependencyTests-324194083 None] Acquiring lock "cinder-quobyte-01b96b30-8a77-4909-804c-5247dbfc7347" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:21 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2e7bcdf2-9f70-4207-9e03-91a805ceabe6 tempest-SnapshotDependencyTests-324194083 None] Lock "cinder-quobyte-01b96b30-8a77-4909-804c-5247dbfc7347" acquired by "delete_volume" :: waited 0.014s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:21 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[110f2a9d-1a7d-495f-875f-fb7f5209e34b]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:21 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2e7bcdf2-9f70-4207-9e03-91a805ceabe6 tempest-SnapshotDependencyTests-324194083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:21 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347 Sep 04 16:09:21 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:22 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2e7bcdf2-9f70-4207-9e03-91a805ceabe6 tempest-SnapshotDependencyTests-324194083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347" returned: 0 in 0.357s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2e7bcdf2-9f70-4207-9e03-91a805ceabe6 tempest-SnapshotDependencyTests-324194083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347 {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:22 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347 Sep 04 16:09:22 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:22 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2e7bcdf2-9f70-4207-9e03-91a805ceabe6 tempest-SnapshotDependencyTests-324194083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-01b96b30-8a77-4909-804c-5247dbfc7347" returned: 0 in 0.255s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2e7bcdf2-9f70-4207-9e03-91a805ceabe6 tempest-SnapshotDependencyTests-324194083 None] Lock "cinder-quobyte-01b96b30-8a77-4909-804c-5247dbfc7347" released by "delete_volume" :: held 0.673s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:22 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-2e7bcdf2-9f70-4207-9e03-91a805ceabe6 tempest-SnapshotDependencyTests-324194083 None] Created reservations ['7c4bfc1f-2781-47e6-b44b-232afde05218', 'b4c796bd-f6a4-42bd-b38c-006f3e9789e3', 'cd86c137-7365-4d45-ab70-a3695b07f3be', '6c56198c-73be-487b-8aef-12b0e4945d65'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:09:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2e7bcdf2-9f70-4207-9e03-91a805ceabe6 tempest-SnapshotDependencyTests-324194083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2e7bcdf2-9f70-4207-9e03-91a805ceabe6 tempest-SnapshotDependencyTests-324194083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2e7bcdf2-9f70-4207-9e03-91a805ceabe6 tempest-SnapshotDependencyTests-324194083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:09:22 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-2e7bcdf2-9f70-4207-9e03-91a805ceabe6 tempest-SnapshotDependencyTests-324194083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:09:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-2e7bcdf2-9f70-4207-9e03-91a805ceabe6 tempest-SnapshotDependencyTests-324194083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2e7bcdf2-9f70-4207-9e03-91a805ceabe6 tempest-SnapshotDependencyTests-324194083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:22 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:09:22 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:22 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-2e7bcdf2-9f70-4207-9e03-91a805ceabe6 tempest-SnapshotDependencyTests-324194083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.232s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:22 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-2e7bcdf2-9f70-4207-9e03-91a805ceabe6 tempest-SnapshotDependencyTests-324194083 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:09:22 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-2e7bcdf2-9f70-4207-9e03-91a805ceabe6 tempest-SnapshotDependencyTests-324194083 None] Deleted volume successfully. Sep 04 16:09:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-2e7bcdf2-9f70-4207-9e03-91a805ceabe6 tempest-SnapshotDependencyTests-324194083 None] Lock "cinder-01b96b30-8a77-4909-804c-5247dbfc7347-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b7764d87-ba2d-4b72-82cb-d0db999ee7ec tempest-SnapshotDependencyTests-324194083 None] Acquiring lock "cinder-3938cef6-1f9e-450c-9e6a-0f0454199adc-delete_volume" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b7764d87-ba2d-4b72-82cb-d0db999ee7ec tempest-SnapshotDependencyTests-324194083 None] Lock "cinder-3938cef6-1f9e-450c-9e6a-0f0454199adc-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b7764d87-ba2d-4b72-82cb-d0db999ee7ec tempest-SnapshotDependencyTests-324194083 None] Acquiring lock "cinder-quobyte-3938cef6-1f9e-450c-9e6a-0f0454199adc" by "delete_volume" {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 16:09:22 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b7764d87-ba2d-4b72-82cb-d0db999ee7ec tempest-SnapshotDependencyTests-324194083 None] Lock "cinder-quobyte-3938cef6-1f9e-450c-9e6a-0f0454199adc" acquired by "delete_volume" :: waited 0.017s {{(pid=87490) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 16:09:22 devstack cinder-volume[87490]: DEBUG oslo.privsep.daemon [-] privsep: reply[65483a65-2c5d-47d0-b1fc-8bbaed1b6d49]: (4, 'qcow2') {{(pid=89119) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 16:09:22 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b7764d87-ba2d-4b72-82cb-d0db999ee7ec tempest-SnapshotDependencyTests-324194083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3938cef6-1f9e-450c-9e6a-0f0454199adc {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:23 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3938cef6-1f9e-450c-9e6a-0f0454199adc Sep 04 16:09:23 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:23 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b7764d87-ba2d-4b72-82cb-d0db999ee7ec tempest-SnapshotDependencyTests-324194083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3938cef6-1f9e-450c-9e6a-0f0454199adc" returned: 0 in 0.379s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b7764d87-ba2d-4b72-82cb-d0db999ee7ec tempest-SnapshotDependencyTests-324194083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3938cef6-1f9e-450c-9e6a-0f0454199adc {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:23 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3938cef6-1f9e-450c-9e6a-0f0454199adc Sep 04 16:09:23 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:23 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b7764d87-ba2d-4b72-82cb-d0db999ee7ec tempest-SnapshotDependencyTests-324194083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f/volume-3938cef6-1f9e-450c-9e6a-0f0454199adc" returned: 0 in 0.265s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b7764d87-ba2d-4b72-82cb-d0db999ee7ec tempest-SnapshotDependencyTests-324194083 None] Lock "cinder-quobyte-3938cef6-1f9e-450c-9e6a-0f0454199adc" released by "delete_volume" :: held 0.682s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:23 devstack cinder-volume[87490]: DEBUG cinder.quota [None req-b7764d87-ba2d-4b72-82cb-d0db999ee7ec tempest-SnapshotDependencyTests-324194083 None] Created reservations ['dcd56a3d-bd39-4de0-8a1d-6486b7408495', '966100cd-c6c6-4e04-ae58-015fec69381e', '1d92d5a2-3ee4-4de1-b6d1-66122bdc4e1a', '48fad2a6-7def-483e-bc57-45776e062d26'] {{(pid=87490) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 16:09:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b7764d87-ba2d-4b72-82cb-d0db999ee7ec tempest-SnapshotDependencyTests-324194083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b7764d87-ba2d-4b72-82cb-d0db999ee7ec tempest-SnapshotDependencyTests-324194083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:23 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b7764d87-ba2d-4b72-82cb-d0db999ee7ec tempest-SnapshotDependencyTests-324194083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:09:23 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-b7764d87-ba2d-4b72-82cb-d0db999ee7ec tempest-SnapshotDependencyTests-324194083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:09:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-b7764d87-ba2d-4b72-82cb-d0db999ee7ec tempest-SnapshotDependencyTests-324194083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b7764d87-ba2d-4b72-82cb-d0db999ee7ec tempest-SnapshotDependencyTests-324194083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:23 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:09:23 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:23 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:23 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-b7764d87-ba2d-4b72-82cb-d0db999ee7ec tempest-SnapshotDependencyTests-324194083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.253s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:23 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-b7764d87-ba2d-4b72-82cb-d0db999ee7ec tempest-SnapshotDependencyTests-324194083 None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:09:23 devstack cinder-volume[87490]: INFO cinder.volume.manager [None req-b7764d87-ba2d-4b72-82cb-d0db999ee7ec tempest-SnapshotDependencyTests-324194083 None] Deleted volume successfully. Sep 04 16:09:23 devstack cinder-volume[87490]: DEBUG cinder.coordination [None req-b7764d87-ba2d-4b72-82cb-d0db999ee7ec tempest-SnapshotDependencyTests-324194083 None] Lock "cinder-3938cef6-1f9e-450c-9e6a-0f0454199adc-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=87490) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 16:09:33 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:UPDATE=32,cinder:SELECT=27,cinder:DELETE=3,cinder:INSERT=7 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:09:33 devstack cinder-volume[87490]: DEBUG dbcounter [-] [87490] Writing DB stats cinder:SELECT=23,cinder:UPDATE=27,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87490) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 16:09:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:09:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 16:09:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 16:09:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787': None} {{(pid=87490) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 16:09:38 devstack cinder-volume[87490]: DEBUG cinder.volume.drivers.quobyte [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ae1f64c-6191-41df-bef8-f96bdb76a787'] {{(pid=87490) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 16:09:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.lockutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87490) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 16:09:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 16:09:38 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f Sep 04 16:09:38 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 16:09:38 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Sep 04 16:09:38 devstack cinder-volume[87490]: DEBUG oslo_concurrency.processutils [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2c42c03933392ae4ff7725fdc6125f0f" returned: 0 in 0.264s {{(pid=87490) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 16:09:38 devstack cinder-volume[87490]: DEBUG cinder.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Notifying Schedulers of capabilities ... {{(pid=87490) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 16:09:38 devstack cinder-volume[87490]: DEBUG oslo_service.periodic_task [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] Running periodic task VolumeManager._thread_info {{(pid=87490) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 16:09:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread count: 29 {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 16:09:38 devstack cinder-volume[87490]: DEBUG cinder.volume.manager [None req-d9528e8c-601d-49a3-b0ef-227e7550bab6 None None] thread info: [<_MainThread(MainThread, started 138899118923904)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87490) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}